aws-cloud-quest / machine-learning

25 quests.
One engineer.

Test Engineering · Jet2.com Weekends · NHS BSc Applied Digital Technologies · BPP

A walkthrough of every AWS Cloud Quest: Machine Learning assignment — the problem each one solves, the AWS services involved, and what it builds toward as a practising data engineer.

// course_progress 25 / 25 complete → 100% 🎉
25
Quests done
15+
AWS services
Commitments
Coffees
// aws_services_touched
SageMaker Bedrock Rekognition Comprehend Textract Polly Transcribe Lambda S3 Kinesis VPC IAM
01 Foundations & Cloud Core 9 quests
☁️
quest_01
Cloud Computing Essentials
✓ done
Amazon S3EC2

A city council needs a static website that survives traffic spikes at zero operational overhead — no servers to patch or provision.

// solution
Migrated to S3 static website hosting — globally available, infinitely scalable, zero infrastructure.

🔑
quest_02
Cloud First Steps
✓ done
IAMAWS Console

A new team needs secure, auditable AWS access without sharing root credentials or over-provisioning permissions to anyone.

// solution
Configured IAM users, groups and least-privilege policies — the security bedrock every subsequent quest builds on.

quest_03
Serverless Foundations
✓ done
AWS LambdaAPI Gateway

A startup needs backend logic that scales to zero during idle periods and costs nothing when not in use — no EC2, no idle bill.

// solution
Built an event-driven Lambda exposed via API Gateway — the serverless pattern underpinning every AI service integration later in the course.

⚙️
quest_04
Computing Solutions
✓ done
EC2Auto ScalingELB

An e-commerce platform has unpredictable traffic surges. Manual capacity planning means constant over-spend or downtime.

// solution
Deployed an Auto Scaling Group behind a load balancer — automatic right-sizing based on real demand, no human intervention needed.

🌐
quest_06
Networking Concepts
✓ done
VPCSubnetsSecurity Groups

A healthcare company needs to isolate sensitive workloads from public internet traffic while still allowing controlled external access.

// solution
Designed a VPC with public/private subnet separation, Internet Gateway and security group rules — network isolation done properly.

💰
quest_07
Cloud Economics
✓ done
Cost ExplorerBudgetsPricing Calculator

A finance team has zero visibility into cloud spend. Bills arrive as a monthly surprise with no attribution to teams or workloads.

// solution
Implemented tagging strategies, budget alerts and Cost Explorer dashboards — full spend attribution and early warning on overruns.

🗄️
quest_11
Databases in Practice
✓ done
Amazon RDSDynamoDB

An application needs relational data for transactions and a NoSQL store for low-latency session data — two workloads, two different requirements.

// solution
Provisioned RDS for structured queries and DynamoDB for high-throughput key-value lookups — right tool, right job.

🔒
quest_16
Core Security Concepts
✓ done
IAMKMSCloudTrail

An organisation needs to prove data at rest is encrypted and every API action is auditable for compliance and governance.

// solution
Enabled KMS-managed encryption on S3 and RDS, CloudTrail capturing all API activity — encryption and auditability locked in.

🌊
quest_17
Data Ingestion Methods
✓ done
Kinesis StreamsFirehoseS3

A logistics company generates thousands of sensor events per second. Batch ETL is too slow — insights are needed in near real-time.

// solution
Built Kinesis → Firehose → S3 streaming pipeline — real-time data delivery for downstream ML and analytics.

02 AI Services & NLP 6 quests
👁️
quest_05
Image and Video Analysis
✓ done
RekognitionS3Lambda

A security firm needs to detect objects, faces, and unsafe content in thousands of images per day — without building a CV model from scratch.

// solution
Integrated Rekognition via Lambda — automated object detection, face analysis and content moderation at scale, zero model training.

🔊
quest_08
Text-to-Speech
✓ done
Amazon PollyS3Lambda

An accessibility platform needs to convert written content into natural-sounding audio across multiple languages — without any audio recording infrastructure.

// solution
Used Polly with SSML markup to generate lifelike speech stored in S3 — fully managed, no audio engineering required.

📄
quest_09
Extract Text from Docs
✓ done
Amazon TextractS3

A legal firm receives thousands of scanned contracts. Manually extracting key fields is slow, error-prone, and impossible to scale.

// solution
Used Textract to extract structured text, tables and key-value pairs from scanned PDFs — unstructured docs turned into queryable data.

💬
quest_12
Customer Sentiment
✓ done
Amazon ComprehendS3Lambda

A retail company wants to understand sentiment trends across thousands of customer reviews without reading them manually.

// solution
Ran Comprehend batch jobs to score sentiment and extract key phrases at scale — turning raw reviews into actionable signal.

🎙️
quest_13
Speech-to-Text
✓ done
Amazon TranscribeS3

A call centre needs to automatically convert recorded calls into searchable transcripts for quality assurance and compliance review.

// solution
Configured Transcribe to process audio from S3, outputting timestamped transcripts — enabling downstream NLP on real conversations.

🚁
quest_14
Spy Drones Detection
✓ done
RekognitionCustom LabelsS3

A facility needs to detect unauthorised drones in surveillance footage — a niche object detection problem the generic Rekognition model doesn't cover.

// solution
Trained a Custom Labels model on drone imagery — fine-tuning AWS computer vision to a specific, real-world detection task.

03 ML Engineering & SageMaker 7 quests
🧪
quest_10
Set Up an ML Environment
✓ done
SageMaker StudioS3

A data science team wastes weeks provisioning GPU instances and managing Jupyter environments before any modelling can begin.

// solution
Spun up SageMaker Studio with managed notebooks and data connections — a full ML dev environment in minutes, not weeks.

📡
quest_18
Anomaly Detection
✓ done
Lookout for MetricsSageMakerCloudWatch

An ops team needs to detect unusual spikes in business metrics before they become customer-impacting incidents — no ML expertise on the team.

// solution
Configured Lookout for Metrics on time-series data — automatic anomaly detection with root-cause groupings, no model training required.

📦
quest_19
Bring Your Own Model
✓ done
SageMakerECRDockerS3

A team has a custom ML model in Python that needs production-grade inference endpoints — without rewriting it for a specific framework.

// solution
Containerised the model with Docker, pushed to ECR, deployed on SageMaker as a real-time endpoint — BYOM done properly.

🧠
quest_21
Fine-Tuning an LLM on SageMaker
✓ done
SageMaker JumpStartS3Training Jobs

An enterprise's foundation model gives generic responses. They need domain-specific answers tuned on proprietary data without training from scratch.

// solution
Fine-tuning an LLM via JumpStart on domain-specific datasets — adapting foundation model behaviour at a fraction of full training cost.

🖼️
quest_22
TensorFlow and Computer Vision
✓ done
SageMakerTensorFlowS3

A team needs to train and deploy a custom image classification model using TensorFlow, without managing the underlying GPU infrastructure themselves.

// solution
Used SageMaker's TensorFlow estimator to train a CV model on managed GPU instances and deploy it as a real-time inference endpoint.

🤖
quest_23
Train Reinforcement Learning Models
✓ done
SageMaker RLAmazon SageMakerS3

An engineering team wants to train an agent to learn optimal decision-making through trial and error — without provisioning simulation environments manually.

// solution
Trained a reinforcement learning model on SageMaker using managed simulation environments — agent learning through reward-based feedback loops.

04 Generative AI 3 quests
quest_15
Introduction to Generative AI
✓ done
Amazon BedrockFoundation Models

A product team wants LLM capabilities in their app but has no ML expertise and can't afford to train a model from scratch.

// solution
Used Bedrock to call foundation models via API — text generation, summarisation and Q&A, zero model infrastructure to manage.

🎨
quest_20
Text-to-Image with Generative AI
✓ done
Amazon BedrockStable DiffusionS3

A creative agency needs to generate product imagery on demand from text descriptions — cutting design turnaround from days to seconds.

// solution
Invoked Stable Diffusion via Bedrock with engineered prompts to generate imagery programmatically, stored directly to S3.

🤖
quest_24
Chatbots with a Large Language Model
✓ done
Amazon BedrockAmazon LexLambda

A customer support team needs an intelligent chatbot that understands natural language intent and gives contextually relevant answers — beyond rigid keyword matching.

// solution
Built a conversational chatbot backed by an LLM via Bedrock, with Lex handling dialogue management — context-aware responses at scale.

🎓 Bonus Quest 1 quest
🏠
quest_25 · bonus
Get Home Safe
✓ done
AWS Cloud Quest Complete Machine Learning Role

The final milestone — completing the full AWS Cloud Quest: Machine Learning role from start to finish, across all 25 quests.

// achievement_unlocked
All 25 quests completed. Full ML role badge earned. Built across nights, weekends and stolen hours between Jet2, the NHS and a degree.

AWS Cloud Quest: Machine Learning — Trained badge
// certification_earned
AWS Cloud Quest: Machine Learning
Badge earned after completing all 25 quests across foundations, AI services, ML engineering and generative AI.