Styjun

Can you mark a new target with the Hunter's Mark spell if the original target shifts to a different plane?

How strong is aircraft-grade spruce?

If every star in the universe except the Sun were destroyed, would we die?

Owner keeps cutting corners and poaching workers for his other company

Yet another calculator problem

Contractor cut joist hangers to make them fit

Chandrayaan 2: Why is Vikram Lander's life limited to 14 Days?

Why is the the worst case for this function O(n*n)

Bit floating sequence

Why do the British opposition parties not want a new election?

Why would an airport be depicted with symbology for runways longer than 8,069 feet even though it is reported on the sectional as 7,200 feet?

Why can't some airports handle heavy aircraft while others do it easily (same runway length)?

How to find a reviewer/editor for my paper?

Problem with listing a directory to grep

Is every sentence we write or utter either true or false?

Why can linguists decide which use of language is correct and which is not?

How invisible hand adjusts stock prices if company is listed on multiple exchanges, under multiple currencies, and one of the currencies plunges?

Stack class in Java8

When calculating averages, why can we treat exploding die as if they're independent?

Who is the uncredited actor leading the squad in the Valerian movie?

Features seen on the Space Shuttle's solid booster; what does "LOADED" mean exactly?

Is mountain bike good for long distances?

Are professors obligated to accept supervisory role? If not, how does it work?

How do you say "to hell with everything" in French?

Recommendation to overcome Lambda function timeout [closed]

How to process SQS queue with lambda function (not via scheduled events)?Run functions that exceed max AWS Lambda timeoutAWS Lambda Invoke does not execute the lambda functionAccessing Large files stored in AWS s3 using AWS Lambda functionsAWS Lambda function skipping DynamoDB recordsAPI timeouts in AWS Lambda?(Alexa) Lambda function timeout when using DynamoDBMutiprocessing in AWS LambdaLong time processing a lambda functionAWS Lambda timeout when another (long) Lambda is invoked

.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty margin-bottom:0;

-1

My lambda function needs to process the records in excel file around 2000 records but in the 15 min am able to process only 500 records how can I proceed with this scenario, I have given full memory

amazon-web-services

share|improve this question

asked Mar 28 at 7:36

Yuvaraj RavikumarYuvaraj Ravikumar

1

closed as off-topic by arnt, EdChum, greg-449, Mạnh Quyết Nguyễn, Mark Rotteveel Mar 28 at 10:49

This question appears to be off-topic. The users who voted to close gave this specific reason:

• "Questions seeking debugging help ("why isn't this code working?") must include the desired behavior, a specific problem or error and the shortest code necessary to reproduce it in the question itself. Questions without a clear problem statement are not useful to other readers. See: How to create a Minimal, Reproducible Example." – arnt, EdChum, greg-449, Mạnh Quyết Nguyễn

If this question can be reworded to fit the rules in the help center, please edit the question.

• 
  
  
  

  
  

  
  
  
  
  
  

  
  
  Well wait one hour then😊, jk. Please provide the code you are using and some sample data, only then someone can help you
  
  – Vaibhav Vishal
  Mar 28 at 7:43
  

  
  
  
  


• 
  
  
  

  
  

  
  
  
  
  
  

  
  
  What you want is called a "profiler".
  
  – arnt
  Mar 28 at 8:01
  

  
  
  
  


• 
  
  
  

  
  

  
  
  
  
  
  

  
  
  Why do you wish to use Lambda? What is your actual end-goal? That is, what does the Excel file contain, what are you "processing" and what are you doing with the results of the process? There might be a different approach you could take but without more information, we cannot assist.
  
  – John Rotenstein
  Mar 28 at 8:21
  

  
  
  
  

add a comment | 

-1

My lambda function needs to process the records in excel file around 2000 records but in the 15 min am able to process only 500 records how can I proceed with this scenario, I have given full memory

amazon-web-services

share|improve this question

asked Mar 28 at 7:36

Yuvaraj RavikumarYuvaraj Ravikumar

1

closed as off-topic by arnt, EdChum, greg-449, Mạnh Quyết Nguyễn, Mark Rotteveel Mar 28 at 10:49

This question appears to be off-topic. The users who voted to close gave this specific reason:

• "Questions seeking debugging help ("why isn't this code working?") must include the desired behavior, a specific problem or error and the shortest code necessary to reproduce it in the question itself. Questions without a clear problem statement are not useful to other readers. See: How to create a Minimal, Reproducible Example." – arnt, EdChum, greg-449, Mạnh Quyết Nguyễn

If this question can be reworded to fit the rules in the help center, please edit the question.

• 
  
  
  

  
  

  
  
  
  
  
  

  
  
  Well wait one hour then😊, jk. Please provide the code you are using and some sample data, only then someone can help you
  
  – Vaibhav Vishal
  Mar 28 at 7:43
  

  
  
  
  


• 
  
  
  

  
  

  
  
  
  
  
  

  
  
  What you want is called a "profiler".
  
  – arnt
  Mar 28 at 8:01
  

  
  
  
  


• 
  
  
  

  
  

  
  
  
  
  
  

  
  
  Why do you wish to use Lambda? What is your actual end-goal? That is, what does the Excel file contain, what are you "processing" and what are you doing with the results of the process? There might be a different approach you could take but without more information, we cannot assist.
  
  – John Rotenstein
  Mar 28 at 8:21
  

  
  
  
  

add a comment | 

My lambda function needs to process the records in excel file around 2000 records but in the 15 min am able to process only 500 records how can I proceed with this scenario, I have given full memory

amazon-web-services

share|improve this question

asked Mar 28 at 7:36

Yuvaraj RavikumarYuvaraj Ravikumar

1

share|improve this question

asked Mar 28 at 7:36

Yuvaraj RavikumarYuvaraj Ravikumar

1

share|improve this question

asked Mar 28 at 7:36

Yuvaraj RavikumarYuvaraj Ravikumar

1

asked Mar 28 at 7:36

Yuvaraj RavikumarYuvaraj Ravikumar

1

asked Mar 28 at 7:36

Yuvaraj RavikumarYuvaraj Ravikumar

1

1 Answer
1

active

oldest

votes

1

You really only have two options if you want to use lambda - either make your code run faster so that it will finish in time, or split up the task so that it can be done by multiple lambdas concurrently.

To split it up, one way would be to have one lambda function that all it does it take your 2000 rows from the excel data and puts out 2000 messages to an SQS queue, and then let multiple lambda process the messages out of the queue.

Sounds to me like you are tying to do too much within a single lambda invocation, not really what it was designed for.

If you really can't split up the work into discrete parts, and can't figure out how to make the lambda run faster, then I would use an EC2 instance to process the file instead.

share|improve this answer

answered Mar 28 at 7:58

E.J. BrennanE.J. Brennan

35.7k44 gold badges6262 silver badges100100 bronze badges

add a comment | 

1

You really only have two options if you want to use lambda - either make your code run faster so that it will finish in time, or split up the task so that it can be done by multiple lambdas concurrently.

To split it up, one way would be to have one lambda function that all it does it take your 2000 rows from the excel data and puts out 2000 messages to an SQS queue, and then let multiple lambda process the messages out of the queue.

Sounds to me like you are tying to do too much within a single lambda invocation, not really what it was designed for.

If you really can't split up the work into discrete parts, and can't figure out how to make the lambda run faster, then I would use an EC2 instance to process the file instead.

share|improve this answer

answered Mar 28 at 7:58

E.J. BrennanE.J. Brennan

35.7k44 gold badges6262 silver badges100100 bronze badges

add a comment | 

1

You really only have two options if you want to use lambda - either make your code run faster so that it will finish in time, or split up the task so that it can be done by multiple lambdas concurrently.

To split it up, one way would be to have one lambda function that all it does it take your 2000 rows from the excel data and puts out 2000 messages to an SQS queue, and then let multiple lambda process the messages out of the queue.

Sounds to me like you are tying to do too much within a single lambda invocation, not really what it was designed for.

If you really can't split up the work into discrete parts, and can't figure out how to make the lambda run faster, then I would use an EC2 instance to process the file instead.

share|improve this answer

answered Mar 28 at 7:58

E.J. BrennanE.J. Brennan

35.7k44 gold badges6262 silver badges100100 bronze badges

add a comment | 

You really only have two options if you want to use lambda - either make your code run faster so that it will finish in time, or split up the task so that it can be done by multiple lambdas concurrently.

To split it up, one way would be to have one lambda function that all it does it take your 2000 rows from the excel data and puts out 2000 messages to an SQS queue, and then let multiple lambda process the messages out of the queue.

Sounds to me like you are tying to do too much within a single lambda invocation, not really what it was designed for.

If you really can't split up the work into discrete parts, and can't figure out how to make the lambda run faster, then I would use an EC2 instance to process the file instead.

share|improve this answer

answered Mar 28 at 7:58

E.J. BrennanE.J. Brennan

35.7k44 gold badges6262 silver badges100100 bronze badges

share|improve this answer

answered Mar 28 at 7:58

E.J. BrennanE.J. Brennan

35.7k44 gold badges6262 silver badges100100 bronze badges

answered Mar 28 at 7:58

E.J. BrennanE.J. Brennan

35.7k44 gold badges6262 silver badges100100 bronze badges

answered Mar 28 at 7:58

E.J. BrennanE.J. Brennan

35.7k44 gold badges6262 silver badges100100 bronze badges