Skip to content
This repository was archived by the owner on Jul 8, 2024. It is now read-only.

Feature/air 191 - #37

Open
is-achakraborty wants to merge 6 commits into
mainfrom
feature/air-191
Open

Feature/air 191#37
is-achakraborty wants to merge 6 commits into
mainfrom
feature/air-191

Conversation

@is-achakraborty

Copy link
Copy Markdown
Contributor

No description provided.

@johnseq-iterative

Copy link
Copy Markdown

@is-achakraborty can you add is-wschumacher and
@is-psharma
is-psharma
and @prajendra-is
to this PR?

@is-wschumacher is-wschumacher left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This comment may or may not be outside of the scope of this review. Generally I would request that the README be updated to reflect the changes made here, however, I note that it looks like the existing actions and README have already diverged, so getting those back in alignment may be a larger task better suited for a follow up review.

@is-rishabhs

Copy link
Copy Markdown
Contributor

@is-achakraborty, Going forward please create commit messages starting with the JIRA ticket number: the commit message. Please follow the same for feature branches and PR creation.

For example
"ISOPS-750: Sample commit message"
"ISOPS-750: Sample PR message"

Branch name could be something like
ISOPS-750-some-feature-branch

This will ensure that the commits, branches and the PR's along with their current status are being tracked on the corresponding JIRA ticket.

@@ -0,0 +1,14 @@
# This file is the sharable action with build,unittest, integration test, code coverage reports.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

please remove this function out. we don't want to have infra provisioning is performed from GitHub Action

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We need to use serverless setup to deploy lambda. I discussed this with @johnseq-iterative and clearly mentioned that infrastructure provisioning code should not be part of this pipeline. If you see the serverless templates here only the lambda specific roles and events are getting created from the template. We are expecting the other infra should already be in place before we run this pipeline.

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@is-ttang Avik and I did discuss this. My understanding is the plan is to keep infra+code provisioning together until we are ready to separate them out. That keeps the CICD responsibility squarely on one team while we wait to e.g. move to gitlab. Does that work as an interim solution?

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sorry -- reading this more closely. @is-achakraborty this makes sense. We'll split out as much as we can from our templates and create out of band. That's fine.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes. but, you can run the SLS provisioning separately. it requires have more privilege for GitHub to access AWS to provision. Second, you just need to run ONCE, NOT run lambda update every time. At moment, GitHub OpenID connect scope is locked down to ECR publish and Lambda S3 write

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Separately means out of the pipeline? If yes then I think no meaning in using this pipeline anymore.
Yes we need the required AWS permissions for the pipeline to work. We can sit together and decide on the minimal subset of permission required.

Comment thread actions/deploy-lambda/action.yaml Outdated
- name: Update container lambda - get image uri with given image tag
- name: Deploy lambda
if: ${{ steps.app_settings.outputs.app_registry == 'ecr' }}

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this step is needed to deploy lambda container

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ok, then I need to distinguish the serverless deployment path. I am going to add an app parameter say deployer: sls in the .cicd-profile.yaml for this purpose. I would make sure that if some one not defines that param in their project then it would take some default value

aws_region:
description: aws region
required: true
aws_account_id:

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this change is to break the pipeline in training-pipeline

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can you give me the repo reference where it is getting used

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

could you make NOT require? so NOT require to make any change in the training-pipeline (repo)

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Comment thread actions/build-ecr-image/action.yml Outdated
Comment thread actions/build-ecr-image/action.yml
@is-achakraborty
is-achakraborty force-pushed the feature/air-191 branch 8 times, most recently from 04ba930 to 18252df Compare January 12, 2023 15:30
@is-achakraborty
is-achakraborty force-pushed the feature/air-191 branch 3 times, most recently from 608c357 to 382bd53 Compare January 12, 2023 18:09
@is-achakraborty
is-achakraborty force-pushed the feature/air-191 branch 5 times, most recently from 6020768 to f6e3610 Compare January 17, 2023 16:29
run: |
echo "push zip..."
aws s3 cp ${{ inputs.repository }}.zip ${{ inputs.registry }}/${{ inputs.env }}/${{ inputs.repository }}.zip
# aws s3 cp ${{ inputs.repository }}.zip ${{ inputs.registry }}/${{ inputs.env }}/${{ inputs.repository }}.zip

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

why remove s3 cp. this action is push Lambda zip

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We are not using this step. sls would take care of building the zip and pushing that to s3.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Development

Successfully merging this pull request may close these issues.

5 participants