Contact
Contact
Stay up to date
We'll highlight new content in your collectives with a blue activity indicator on navigation items and posts.
Manage preferences
Can you answer these questions?
View all unanswered questionsThese questions still don't have an answer
-1
votes
0
answers
15
views
Spark + Iceberg + Polaris REST Catalog returns InvalidAccessKeyId/AWS Access Key Invalid despite correct credentials
I am running Apache Spark 3.5.5 with Apache Iceberg using a Polaris REST catalog backed by S3-compactible object storage (non-AWS, but using AWS SDK/S3A)
Spark starts successfully, the Polaris catalog ...
- 1
0
votes
0
answers
36
views
Is there a method for identifying the original query associated with a cursor in Redshift?
We have a large redshift deployment (64 nodes at ra3.16xl) that we are trying to optimize and downsize. Part of the problem is that we have a huge proliferation of tables and adhoc queries that are ...
- 1,188
-1
votes
0
answers
64
views
DynamoDB UpdateItem ConditionExpression with tenantid enforced with IAM PrincipalTags
I want to update a dynamodb item using UpdateItem, from a Cognito User with a Cognito JWT. The db has a GSI1=TenantId. Items look like:
...
- 2,057
-1
votes
0
answers
42
views
AWS Lambda .NET: 300ms Idle Period Between Tasks in Same Invocation
I'm observing consistent ~300ms idle gaps between sequential tasks (usually DB queries) within a single Lambda invocation, visible in Datadog & CloudWatch logs. This isn't a cold start (confirmed ...
- 327
0
votes
0
answers
27
views
Reparse external dag from current dag in Airflow 3.0.6
We are planning airflow upgrade from 2.7 to 3.0.6. Here we are triggering external dag it is refreshed and having the expected tasks.
with 2.6 version, there was direct access to database but 3.0.7 ...
Recommended answers
View all recommended answersThese answers have been recommended
Advice
1
vote
5
replies
47
views
Preparing for AWS Cloud Practitioner exam – are W3Schools notes sufficient?
I’m currently preparing for the AWS Certified Cloud Practitioner (CLF-C02) exam. So far, I’ve been studying AWS basics using W3Schools AWS tutorials and Skill builder Essentail course. However, I ...
- 3,387
Answer
A good place to discuss AWS Certifications is: https://www.reddit.com/r/AWSCertifications/ Cloud Practitioner is fairly high-level, so online courses are sufficient. For later certifications, you'll ...
Advice
0
votes
2
replies
53
views
Can anyone explain the overall architecture of AWS Lambda backend to me?
I have experience in frameworks like Django, Flask and FastAPI. Now I have a project requirement to do this in Lambda architecture.
Do I need to just vibe code it or learn and understand first, then ...
- 80k
Answer
In response to your question on whether you need to understand Lambda before diving in: no, but understanding is much better than not understanding. Recommend that you read the plentiful documentation ...
View answer
- 80k
1
vote
1
answer
69
views
How to create S3 Tables using CloudFormation without getting namespace does not exist errors?
I want to deploy a very basic S3 Table setup using CloudFormation:
...
- 80k
Answer
Accepted
I think the documentation for AWS::S3Tables::Namespace is wrong or misleading (or the CloudFormation service is bugged). It states that the return value from Ref ...
View answer
- 80k
5
votes
2
answers
162
views
How to prevent race condition in AWS DynamoDB and Lambda
I have a pipeline where:
Lambda A reads DynamoDB and publishes events to Kinesis
Kinesis partitions events by key
Lambda B consumes the stream and writes the latest record per key back to DynamoDB
...
- 24.3k
Answer
Use optimistic locking: In distributed systems like DynamoDB, item version control using optimistic locking prevents conflicting updates. By tracking item versions and using conditional writes, ...
View answer
- 80k
2
votes
2
answers
86
views
When updating different attributes on an item in multiple requests are race conditions still possible?
When doing an UpdateItem on specific ddb record, if two separate clients attempt to update different attributes on the same record can race conditions still occur?
Example: consider a record
...
- 20.5k
Answer
When two clients update different attributes of the same item concurrently, each UpdateItem operation is atomic and modifies only its specified attributes, so both updates should succeed without ...
View answer
- 80k
See what's trending
View all trending questionsThese are the most active questions in AWS Collective
1158
votes
44
answers
989k
views
Downloading an entire S3 bucket?
I noticed that there does not seem to be an option to download an entire s3 bucket from the AWS Management Console.
Is there an easy way to grab everything in one ...
- 3,085
1016
votes
42
answers
769k
views
"UNPROTECTED PRIVATE KEY FILE!" Error using SSH into Amazon EC2 Instance (AWS) [closed]
I've created a new linux instance on Amazon EC2, and as part of that downloaded the .pem file to allow me to SSH in.
When I tried to ...
- 60.8k
337
votes
71
answers
725k
views
Amazon S3 - How to fix 'The request signature we calculated does not match the signature' error?
I have searched on the web for over two days now, and probably have looked through most of the online documented scenarios and workarounds, but nothing worked for me so far.
I am on AWS SDK for PHP V2....
- 1,211
485
votes
38
answers
352k
views
How to get an AWS EC2 instance ID from within that EC2 instance?
How can I find out the instance id of an ec2 instance from within the ec2 instance?
556
votes
23
answers
642k
views
Change key pair for ec2 instance
How do I change the key pair for my ec2 instance in AWS management console? I can stop the instance, I can create new key pair, but I don't see any link to modify the instance's key pair.
- 70.2k
Learn something new
These are the most recent articles in AWS Collective
0
votes
390
views
1 minute read
AWS Management Console now supports simultaneous sign-in for multiple AWS accounts
AWS has changed the way we interact with AWS console for sign-in. Jan 16, 2025 AWS has announced the support for multiple console sessions for signing into different aws accounts in the same browser.
...
- 12k
4
votes
595
views
8 minute read
How to achieve fast, scalable, robust & cost optimized scaling of tasks on AWS ECS
Summary
There are multiple use cases to containerize and host proprietary applications on AWS ECS which is “a fully managed container orchestration service that makes it easy for you to deploy, manage,...
- 3,024
8
votes
695
views
2 minute read
Overcoming Front-End Back-End Coupling with AWS Event-Driven Architecture
introduction
As a developer, I've always been interested in event-driven architectures (EDAs) and how they can improve the overall performance and scalability of web applications. However, I never ...
- 1,045
6
votes
1k
views
1 minute read
Always-on access for your data in Amazon S3, using cross-Region replication and Multi-Region Access Points (MRAP)
To improve durability of your data in the cloud, you should replicate it to multiple locations. For data in Amazon S3, it is automatically stored across multiple devices spanning a minimum of three ...
- 1,125
6
votes
1k
views
3 minute read
Local development, testing, and debugging of serverless applications defined in Terraform using AWS SAM CLI
One question we hear from developers using Terraform and AWS Lambda functions is how to locally test the Lambda function. Here’s a great example — I have a simple terraform file with a Lambda function....
- 159
Members can contribute articles
Simply submit a proposal, get it approved, and publish it.
See how the process works
Simply submit a proposal, get it approved, and publish it.
See how the process works