AWS新增DEA-C01认证考试知识要点

本文由云计算狂魔公众号提供

由于AWS将于3月12日正式启动DEA-C01认证考试，我们整理了相关考试知识要点，请各位考生了解。

Compute

In the Compute category of our AWS Certified Data Engineer Associate (DEA-C01) exam cheat sheet, we delve into the essential AWS compute services that are integral to the exam.

This section provides key insights and facts about services including Amazon EC2, and Amazon ECS/EKS, which are fundamental in data engineering on AWS.

Understanding these compute services is vital for tackling the DEA-C01 exam, as they form the backbone of many data processing and analytics solutions in the AWS ecosystem. 

Amazon EC2 (Elastic Compute Cloud):

• EC2 Instances: Amazon EC2 provides resizable compute capacity in the cloud, allowing you to launch virtual servers (instances) as needed.

• Instance Types: EC2 offers a variety of instance types optimized for different use cases, such as compute-optimized, memory-optimized, and storage-optimized instances.

• Elastic Block Store (EBS): EC2 instances use EBS volumes for persistent storage. EBS volumes offer different types like General Purpose (SSD), Provisioned IOPS (SSD), and Magnetic.

• Security Groups: These act as virtual firewalls for EC2 instances, controlling inbound and outbound traffic at the instance level.

• Elastic IP Addresses: These are static IP addresses designed for dynamic cloud computing, allowing you to allocate and assign a fixed IP address to an EC2 instance.

• Key Pairs: EC2 uses public-key cryptography to encrypt and decrypt login information. To log into your instances, you must create a key pair.

• Amazon Machine Images (AMIs): AMIs are templates that contain the software configuration (operating system, application server, applications) required to launch an EC2 instance.

• Instance Store Volumes: These provide temporary block-level storage for some EC2 instances. Data on instance store volumes is lost if the instance is stopped or terminated.

• Auto Scaling: This feature allows you to automatically scale your EC2 capacity up or down according to conditions you define.

• Elastic Load Balancing (ELB): ELB automatically distributes incoming application traffic across multiple EC2 instances, improving application scalability and reliability.

• Pricing Models: EC2 offers several pricing options, including On-Demand, Reserved Instances, and Spot Instances, each catering to different business needs and cost optimization strategies.

• VPC Integration: EC2 instances are launched in a Virtual Private Cloud (VPC) to provide network isolation and connection to your own network.

• Monitoring and Logging: Integration with Amazon CloudWatch allows for monitoring the performance of EC2 instances, providing metrics like CPU utilization, disk I/O, and network usage.

• EC2 Instance Lifecycle: Understanding the lifecycle phases of an EC2 instance, including launching, starting, stopping, rebooting, and terminating.

• AMI Customization: Ability to create custom AMIs from existing instances, which can be used to launch new instances with pre-configured settings.

Amazon Elastic Kubernetes Service (Amazon EKS):

• EKS Overview: Amazon EKS is a managed service that makes it easy to run Kubernetes on AWS without needing to install, operate, and maintain your own Kubernetes control plane or nodes.

• Kubernetes Clusters: EKS runs Kubernetes control plane instances across multiple Availability Zones to ensure high availability. It automatically detects and replaces unhealthy control plane instances, and it provides automated version upgrades.

• Integration with AWS Services: EKS integrates with AWS services like Elastic Load Balancing for distributing traffic, IAM for authentication, and Amazon VPC for networking.

• Worker Nodes Management: While EKS manages the Kubernetes control plane, the responsibility of managing worker nodes that run the applications lies with the user. These can be EC2 instances or AWS Fargate.

• EKS with Fargate: AWS Fargate is a serverless compute engine for containers that works with EKS. Fargate removes the need to provision and manage servers, and you only pay for the resources required to run your containers.

• Networking in EKS: EKS can be integrated with Amazon VPC, allowing you to isolate your cluster within your own network and connect to your existing services or resources.

• Load Balancing: EKS supports Elastic Load Balancing (ELB), which automatically distributes incoming application traffic across multiple targets, such as EC2 instances.

• Security: EKS integrates with AWS IAM, providing granular control over AWS resources. Security groups can be used to control the traffic allowed to and from worker node instances.

• Logging and Monitoring: EKS integrates with Amazon CloudWatch and AWS CloudTrail for logging and monitoring. CloudWatch collects and tracks metrics, collects and monitors log files, and sets alarms.

• Persistent Storage: EKS supports Amazon EBS and Amazon EFS for persistent storage of Kubernetes pods.

• Scalability: EKS supports horizontal pod autoscaling and cluster autoscaling. Horizontal Pod Autoscaler automatically scales the number of pods, and Cluster Autoscaler adjusts the number of nodes.

• Kubernetes API Compatibility: EKS provides a fully managed Kubernetes API server that you can interact with using your existing tools and workflows.

• EKS Console: AWS provides a management console for EKS, simplifying the process of creating, updating, and deleting clusters.

• EKS Pricing: EKS pricing is based on the number of hours that your Kubernetes control plane runs, with no minimum fees or upfront commitments.

Amazon Elastic Container Service (Amazon ECS):

• ECS Overview: Amazon ECS is a fully managed container orchestration service that makes it easy to deploy, manage, and scale containerized applications using Docker.

• Container Definition and Task Definitions: In ECS, a container definition is part of a task definition. It specifies how to run a Docker container, including CPU and memory allocations, environment variables, and networking settings.

• ECS Tasks and Services: A task is the instantiation of a task definition within a cluster. An ECS service allows you to run and maintain a specified number of instances of a task definition simultaneously.

• Cluster Management: ECS clusters are logical groupings of tasks or services. You can run ECS on a serverless infrastructure that’s managed by AWS Fargate or on a cluster of EC2 instances that you manage.

• Integration with AWS Fargate: AWS Fargate is a serverless compute engine for containers that removes the need to provision and manage servers. With Fargate, you specify and pay for resources per application.

• Networking and Load Balancing: ECS can be integrated with Amazon VPC to provide isolation for the containerized applications. It also supports Elastic Load Balancing (ELB) for distributing incoming traffic.

• Storage with EBS and EFS: ECS tasks can use EBS volumes for persistent storage, which persists beyond the life of a single task. ECS can also integrate with EFS for shared storage between multiple tasks.

• IAM Roles for Tasks: ECS tasks can have IAM roles associated with them, allowing each task to have specific permissions.

• Logging and Monitoring: ECS integrates with Amazon CloudWatch for logging and monitoring. CloudWatch Logs can collect and store container logs, and CloudWatch metrics can monitor resource utilization.

• ECS Scheduling and Orchestration: ECS includes built-in schedulers for running containers based on resource needs and other requirements. It also supports integration with third-party schedulers.

• Service Discovery: ECS supports service discovery, which makes it easy for your containerized services to discover and connect with each other.

• ECS Security: Security in ECS involves securing the container instances, managing access to the ECS resources through IAM, and network traffic control with security groups and network ACLs.

• ECS Pricing: Pricing for ECS is based on the resources you use, such as EC2 instances or Fargate compute resources. There is no additional charge for ECS itself.

• Container Agent: ECS uses a container agent running on each container instance in an ECS cluster. The agent sends information about the resource’s current running tasks and resource utilization to ECS.

Storage

In the Storage section of our AWS Certified Data Engineer Associate (DEA-C01) exam cheat sheet, we focus on Amazon S3, S3 Select, Glacier, and EBS – key AWS storage services essential for data engineering.

This section provides detailed insights into Amazon S3 for object storage, S3 Select for efficient data querying, Glacier for long-term archival, and EBS for block-level storage.

Understanding the functionalities, use cases, and best practices of these services is crucial for the DEA-C01 exam, as they are fundamental in designing and implementing effective, scalable, and cost-efficient storage solutions in AWS.