Case Studies

Import big data into AWS as fast as possible

Industry

Product name

Client

Scroll down

A quick look

Our client needed to import big data as fast as possible but at the same time ensure enough cloud infrastructure capacity to run the client's e-commerce website and mobile app.

Implementation schema

Our Mission

Build a scaling mechanism to spin-up or kill-off Fargate ECS services processing Messaging Queues.

Our Approach

Our solution was a Lambda function which scales the ECS services processing the Messaging Queues. The Lambda function is based on an algorithm that calculates the available IOPS of the database, in order to make sure that the ECS services process the Messaging Queues as fast as possible, without causing any interruption in the availability of the web page.

Outcomes

  • Easy communication between the Lambda and ECS via the Python AWS SDK
  • The cloudwatch event to trigger the Lambda in a desired time period
  • Prioritization of the ECS tasks via a configuration file in the Lambda. This was impossible to achieve with a native ECS cron solution for example.
  • Accurate calculation of the available RDS IOPS

More of our work

Online Fertility Wiki

Fertilitypedia is a portal that provides all IVF related information. You can evaluate your own individual chance to conceive, receive information about possible diagnosis and search for help instantly.

See more

P2P car sharing

HoppyGo is a European car sharing startup that through its app and web application enables you to list or rent a car, browse available car and automatically process payment

See more