Download Updated Frontend and Backend Code

Backup the existing folders

cp -R challenge-day2/ challenge-day2_bkp
cp -R terraform-project/ terraform-project_bkp

Clean up the existing application files expect the Docker, YAML file (Backend)

cd challenge-day2/backend
rm -rf $(find . -mindepth 1 -maxdepth 1 -not \\( -name ".*" -o -name Dockerfile -o -name "*.yaml" \\))

Clean up the existing application files expect the Docker, YAML file (Frontend)

cd challenge-day2/frontend
rm -rf $(find . -mindepth 1 -maxdepth 1 -not \\( -name ".*" -o -name Dockerfile -o -name "*.yaml" \\))

Download the updated source code and unzip it (Backend)

cd challenge-day2/backend
wget  <https://tcb-public-events.s3.amazonaws.com/mdac/resources/final/cloudmart-backend-final.zip>
unzip cloudmart-backend-final.zip

Download the updated source code and unzip it (Frontend)

cd challenge-day2/frontend
wget  <https://tcb-public-events.s3.amazonaws.com/mdac/resources/final/cloudmart-frontend-final.zip>
unzip cloudmart-frontend-final.zip
git add -A
git commit -m "final code"
git push 

Google Cloud BigQuery Setup

Follow these steps to set up Google Cloud BigQuery for CloudMart:

1. Create a Google Cloud Project:
   • Go to the Google Cloud Console (https://console.cloud.google.com/).
   • Click on the project dropdown and select "New Project".
   • Name the project "CloudMart" and create it.
2. Enable BigQuery API:
   • In the Google Cloud Console, go to "APIs & Services" > "Dashboard".
   • Click "+ ENABLE APIS AND SERVICES".
   • Search for "BigQuery API" and enable it.
3. Create a BigQuery Dataset:
   • In the Google Cloud Console, go to "BigQuery".
   • In the Explorer pane, click on your project name.
   • Click "CREATE DATASET".
   • Set the Dataset ID to "cloudmart".
   • Choose your data location and click "CREATE DATASET".
4. Create a BigQuery Table:
   • In the dataset you just created, click "CREATE TABLE".
   • Set the Table name to "cloudmart-orders".
   • Define the schema according to your order structure. For example:
     • id: STRING
     • items: JSON
     • userEmail: STRING
     • total: FLOAT
     • status: STRING
     • createdAt: TIMESTAMP
   • Click "CREATE TABLE".
5. Create Service Account and Key:
   • In the Google Cloud Console, go to "IAM & Admin" > "Service Accounts".
   • Click "CREATE SERVICE ACCOUNT".
   • Name it "cloudmart-bigquery-sa" and grant it the "BigQuery Data Editor" role.
   • After creating, click on the service account, go to the "Keys" tab, and click "ADD KEY" > "Create new key".
   • Choose JSON as the key type and create.
   • Save the downloaded JSON file as google_credentials.json.
6. Configure Lambda Function:

   • Navigate to the root directory of your project.

   • Enter the Lambda function directory:

     cd src/lambda/addToBigQuery
     
     

   • Install the required dependencies:

     sudo yum install npm
     npm install
     
     

   • Edit the google_credentials.json file in this directory and place the content of your key.

   • Create a zip file of the entire directory:

     zip -r dynamodb_to_bigquery.zip .
     
     

   • This zip file will be used when creating or updating the Lambda function.

   • Return to the root directory of your project:

     cd ../../..