Skip to content

The mapping functions are handled in the same function? #761

Closed Answered by JosepSampe
FTWH asked this question in Q&A
Discussion options

You must be logged in to vote

Independently of the memory size, AWS Lambda provides the parallelism by starting a separate container for each activation of a map(). By default, each started container processes 1 element of the iterable. For example, if the iterable of a map(func, itrerable) contains 1000 elements, Lithops + AWS lambda will start 1000 separate containers, each one processing one element of the iterable.

For memory sizes > 1769MB, where you get more than one cpu per container, you can use the worker_processes config key to send multiple activation to the same worker, this way you will leverage all the CPUs in a container.

Replies: 1 comment

Comment options

You must be logged in to vote
0 replies
Answer selected by JosepSampe
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Category
Q&A
Labels
None yet
2 participants