Stay up to date
We'll highlight new content in your collectives with a blue activity indicator on navigation items and posts.
Manage preferences
Questions
Browse questions with relevant AWS tags
259,974 questions
0
votes
0
answers
7
views
Stream Recorder Using FFmpeg Fails on AWS Lambda
I am trying to stream audio from URLs and save them to a file in S3 using AWS Lambda with FFmpeg. Here is an example FFmpeg command I'm using:
ffmpeg -hide_banner -loglevel error -t 10 -i http://...
0
votes
0
answers
8
views
Using spark to read data from MinIO
I have been trying to pull data from MinIO using spark using s3a but when running the code there was not much happening when I set the log level to debug it found that the connection with minIO is not ...
0
votes
1
answer
12
views
How can I get all thing names from a thing group in AWS IoT Core using a Lambda function?
I'm trying to get all the thing names that are part of a specific thing group in AWS IoT Core using a Python Lambda function.
I checked the Boto3 documentation looking for a function that retrieves ...
0
votes
0
answers
23
views
How do I execute a jar file as part of a kotlin application?
Quick background: I'm working on an application to upload some csv data to a third party vendor. We have an AWS S3 bucket that watches for file uploads and the triggers a Lambda. The lambda then runs ...
- 1,701
0
votes
0
answers
16
views
aws opensearch serverless service inside a vpc endpoint does not work from java app in local machine
I am trying to connect to an AWS OpenSearch Serverless collection that is deployed inside a VPC endpoint (PrivateLink) from a Java application running on my local machine. My setup is as follows:
I ...
- 4,454
0
votes
0
answers
7
views
Environment Variables Not Working in React + Vite App (AWS Cognito Auth Issue)
I'm building a React application with Vite that uses AWS Cognito for authentication. I'm having issues with environment variables not being properly loaded or accessible in my application. ...
0
votes
0
answers
21
views
Enable CORS for simple GET on AWS API Gateway resource with Cognito authorizer
I have an AWS API Gateway resource /foo with a GET method. It has a Lambda integration, which for the purposes of this question simply returns bar. However I want the API to be protected, so I have ...
- 21.7k
0
votes
0
answers
34
views
Kubernetes POD gets restarted when JAVA object gets called
Im new in JAVA development and trying to use the AWS SDK for route 53 service to fetch the hosted Zone name for specific URL .
Below is the code snippet.
String url = "abc.abc.abc.com&...
- 2,812
0
votes
0
answers
5
views
Next.js SSR page shows outdated JSON-driven UI momentarily despite backend update (Amplify hosted)
We're using Next.js with Server-Side Rendering (SSR) for the homepage, and the app is hosted on AWS Amplify with CloudFront in front. have a express backend (seperate service on ec2)
Next.js version: ...
0
votes
1
answer
13
views
Astro + S3 + CloudFront: Clicking navigation link causes redirect to wrong path (/WEBSITE/pricing)
I'm deploying an Astro static site to S3 and serving it via CloudFront. Here's my deploy script:
"deploy": "npm run build && aws s3 sync dist s3://mybucket/WEBSITE --delete"...
- 35
-1
votes
1
answer
8
views
Will terraform recreate my ECR if I manually switch to the new aws native basic scanning?
In the AWS console, my ECR is prompting to upgrade to the new AWS Native scanning technology. I want to upgrade as the old scanning version will no longer be supported later this year, but I don't see ...
- 291
-1
votes
0
answers
15
views
Using AWS Batch with EC2 + SPOT instances cost
We have an application that processes videos after they’re uploaded to our system, using FFmpeg for the processing. For each video, we queue a Batch job that spins up an EC2 instance. As far as I ...
- 1
0
votes
1
answer
23
views
AWS Java SDK v2.0: How to handle providing indexNames at runtime rather than using annotation
I have a project using DynamoDB which I'm upgrading to Java SDK v2.0
Using the new enhanced client and type mapping.
I have an index name which I need to pass to @DynamoDbSecondaryPartitionKey,
...
- 182
0
votes
1
answer
19
views
Type-safe method for tracking dynamically exported parameters in base/derived classes
I'm working on an AWS CDK project using TypeScript and I'm trying to improve type safety for a parameter tracking system I've implemented. I have a base class that allows child stacks to export ...
- 1,083
-3
votes
1
answer
32
views
count value depends on resource attributes that cannot be determined until apply in module
I've seen this question asked elsewhere but I don't think it quite addresses the issue I'm having.
We're using a module to create an assumeable role:
module "service_task_role" {
source ...
- 8,098
-1
votes
0
answers
11
views
GPU operator Node Feature Discovery not identifying correct gpu nodes
I am trying to create a gpu container for which I'll be need gpu operator. I have one gpu node g4n.xlarge setup in my EKS cluster, which has containerd runtime. My node has node=ML label set.
When i ...
- 29
-1
votes
0
answers
25
views
AWS RDS Postgres data to S3 [closed]
I have a requirement to archive data that is older than one year from a PostgreSQL database hosted on AWS RDS to an S3 bucket. While this task can be accomplished using a Java application, I would ...
- 19
0
votes
0
answers
17
views
AWS Bedrock with Anthropic Claude 3.5 Sonnet returns 500 in lambda
I'm trying to use an AWS Lambda function to get a response to a user prompt. I'm using anthropic.claude-3-5-sonnet-20240620-v1:0 as the model.
Following is the current code I'm using in my Lambda ...
- 145
-1
votes
1
answer
27
views
Lambda Function to Delete Object after interrogation of file, triggered by S3 Create event not deleting file
I have a Lambda function that is triggered by S3 Put when a file gets uploaded to the bucket. After interrogating the file, I move to delete the file if it fails some checks - in my test I am just ...
0
votes
0
answers
22
views
DynamoDB query with FilterExpression returns no results even when records exist
I'm querying a DynamoDB GSI (parentUploadId-index) to get the first incomplete record (where status <> "COMPLETED") for a given parentUploadId. Here's my code:
public async Task<(...
- 107
0
votes
0
answers
16
views
Jenkins Terraform pipeline gives InvalidClientTokenId error
When running terraform plan, or in this case for testing, aws sts get-caller-identity via pipeline stage, I'm getting the error:
An error occurred (InvalidClientTokenId) when calling the ...
-1
votes
0
answers
39
views
Selenium/Headless Chrome always gets Amazon CAPTCHA – how to avoid or solve?
I'm using Selenium with headless Chrome to automate login and scraping on Amazon, but I'm constantly being redirected to a CAPTCHA page like this one :see screenshot.
I've tried all the usual anti-...
0
votes
0
answers
12
views
AWS CDK, Adding Filters to KinesisEventSourceProps
I'm trying to use Filters on a KinesisEventSourceProps to filter out JSON where Service is equal to "NotKnown":
{
"Meta": {
"Service": "NotKnown",
...
- 1
0
votes
0
answers
17
views
AWS Lambda (Node.js) with Sharp Layer still throws error: "Cannot find module 'sharp'"
I'm trying to use the sharp library in my AWS Lambda function (Node.js 22.x) to compress images uploaded via API Gateway. I’ve added sharp as a Lambda Layer and referenced it in my AWS SAM template.
...
- 33
0
votes
0
answers
21
views
Confused about AWS Cognito architecture: How is native social login on mobile is supposed to word?
I'm trying to clarify the right architecture for using AWS Cognito with Google Sign-In on mobile (Flutter/Android/iOS). I’ve already implemented a working version using Cognito User Pools with Google ...
- 10.9k
-3
votes
0
answers
16
views
How to scale beyond 100 ALB listener rules in AWS for multi-tenant setup? [closed]
I'm using the open-source web analytics platform Matomo for multiple clients, each with a custom domain. This is hosted on AWS, and I'm using an Application Load Balancer (ALB) to route traffic based ...
0
votes
0
answers
22
views
Springboot with JPA cannot save Auto Increment field in redshift
Tried to store data into redshift table from spring boot. Got an error because of the auto increment ID column. Below is the code and error.
Entity class
@Entity
@Data
@Table(name = "...
- 344
0
votes
0
answers
16
views
Query super in redshift for values with a forward slash
In redshift I have data in a super type column roles like
{"foo":true, "foo/bar":true}
I can query for foo like
WHERE roles.foo = true
I cannot work out how to escape to query ...
- 45
0
votes
1
answer
21
views
Is it possible to regain access to an EC2 instance without the PEM key and without stopping the instance?
I'm new to AWS and currently have an EC2 instance running for which I’ve unfortunately lost the .pem key needed for SSH access. When I try to use the “Connect” feature from the AWS Console, I receive ...
- 1
0
votes
0
answers
24
views
Intermittent pending state issues with Spring Boot API on Kubernetes AWS under low load [closed]
We have our Spring Boot application deployed on Kubernetes AWS. What's happening is one API that is being called frequently sometimes goes into a pending state, about 1 in 100 API calls. This occurs ...
0
votes
2
answers
24
views
Having a static IP when an AWS ECS connects to our on-prem services [closed]
I have applications running in AWS ECS.
They are internet facing, and use AWS RDS.
As an internet application they work fine.
What I want to be able to do, is when those applications call a service in ...
- 1
0
votes
1
answer
16
views
Having trouble triggering Cloudwatch metrics from Lambda using CDK
I have created a CDK Stack to track errors occurring in my critical Lambda functions. Slimmed down to a minimal example, the CDK stack is something like this:
// Stack
// -----
{
...
const ...
- 1,683
0
votes
1
answer
53
views
Redshift Join on Regex Match
Attempting to join one table (Table a) with a string (field fruit) against another table (Table b) with a list of comma separated strings (field all_fruits) as the join condition. I want to return ...
- 423
-1
votes
0
answers
19
views
AWS Lambda + NestJS: Only root endpoint works, other routes return 500 error
I have a NestJS application deployed as an AWS Lambda function. The root endpoint (/) works perfectly, but all other routes return a 500 Internal Server Error.
Environment:
NestJS
AWS Lambda (Node.js ...
- 35.3k
0
votes
1
answer
27
views
liquibase redshift setup - "current transaction is aborted" error
I am trying to get Liquibase set up so that it can manage changes to a Redshift database. I have the Liquibase Redshift extension working and am using the Redshift JDBC driver. When I run the update ...
- 106
0
votes
2
answers
10
views
Testing DLQ in Opensearch ingestion pipeline
I am using aws opensearch ingestion pipeline for linking data from ddb to opensearch. I have setup the dlq configuration.
But I am stuck at forcing a pipeline to send messages to DLQ.
Any easy way to ...
- 1,740
1
vote
0
answers
26
views
SEARCH sintaxis for AWS Boto3 client (Python) query expression
i'm trying to get information for NetworkIn and NetworkOut metrics with boto3 client for python, using the get_metric_data method.
I am using the boto3 library and the client like this:
Client = boto3....
- 11
-2
votes
0
answers
26
views
Migration from EC2 to Hetzner [closed]
I am completely new to Hetzner. I wanted to migrate my VM from T3 Medium EC2 to CX22.
A quick background, I am a solo developer (Indian) starting my own company/web application.
In AWS, my ...
-1
votes
0
answers
33
views
Migrate from Node.js 16.x to 22.x
About 2 years ago I learned just enough about writing an Alexa skill to get a simple one made and deployed. It was done using Node.js 16.x. Now I have been required to upgrade to 22.x and the skill no ...
0
votes
0
answers
26
views
Should I save previously built and deployed docker images in AWS ECR
The system I work on has the following build / deploy flow:
Build: build the docker image
Build: push the built image to a private AWS ECR
Deploy: pull the built image from private AWS ECR
Deploy: ...
0
votes
0
answers
27
views
Why are some AWS VPC Route Table actions disabled
I'm seeing different behavior in the AWS Management Console between users who sign in via AWS SSO (IAM Identity Center)
In the VPC console under Route Tables, some action items in the "Actions&...
- 1
0
votes
0
answers
11
views
Opensearch collapse inner_hits alternative
{
"collapse": {
"field": "syndication_title.keyword",
"max_concurrent_group_searches": 4,
"inner_hits": {
"name": "collapsed_docs",...
-2
votes
0
answers
31
views
Unsupported self_managed_kafka_event_source_config block type in terraform - Encryption
I’m trying to create an AWS Lambda event source mapping for a self-managed Kafka cluster using the aws_lambda_event_source_mapping resource. However, I’m encountering the following error:
Error: ...
- 695
-3
votes
0
answers
16
views
How can I filter out all small talk, reminders, emojis, date, time, name, numeric messages, and retain only actual questions/FAQs?
I'm building a horizontal stacked bar graph in Amazon QuickSight using user chat data. The messageContent field includes various types of messages such as:
FAQs (user questions)
Appointment and ...
0
votes
1
answer
40
views
AWS: cannot connect to SSM from Lambda inside VPC
My Lambda is located in VPC (I can access Redis that is inside VPC), but I also need to access SSM - getParameter, but I get a timeout exception.
Code:
※ It used to work until I put it inside the VPC.
...
1
vote
1
answer
27
views
How to create a single CloudWatch EventBridge rule for multiple AWS DMS tasks finishing full load?
I'm using AWS DMS to migrate data from several sources into Redshift. For each replication task, I want to trigger a Lambda function when the full load finishes. Currently, I'm creating a separate AWS:...
- 347
0
votes
0
answers
16
views
Re-index open search and open search capacity to ingest new data
Recently, I joined a new project. In this project, we use a lot OpenSearch. There are 2 things the previous developers did that sound wrong to me.
The developer created a way to re-index the ...
- 3,624
0
votes
1
answer
16
views
Can't connect to Redshift from Fargate
I have a publicly accessible Redshift cluster in two public subnets with public ips and an IGW attached. Its security group allows access on port 5439 from my own IP and from within another sg. Inside ...
- 71
0
votes
1
answer
41
views
AWS Glue 3.0 pythonshell Incompatable versions error
I am programming a data lake with ETL and analytics project and I am using AWS S3 for storage, Glue to create and run the job, and Crawler and athena to create the tables. I am struggling with this ...
- 9
0
votes
1
answer
40
views
AWS conflict between aws.java.sdk.core and aws.java.sdk.s3 JDK 21
Trying to move an application from JDK 8 to JDK 21 and getting an issue with AWS.
I'm using Eclipse and its pushing me to add both these to the module-info.java
In my pom.xml I'm pulling in the ...
- 21
Members can contribute articles
Simply submit a proposal, get it approved, and publish it.
See how the process works
Simply submit a proposal, get it approved, and publish it.
See how the process works