Friday, August 8, 2025

Lambda Cold Start, Warm Start & Provisioned Concurrency | Overview.

Lambda Cold Start, Warm Start & Provisioned Concurrency - Overview.

Scope:
  • Intro,
  • The concept: A Cold Start,
  • Cold start process,
  • How Cold starts adds extra latency,
  • The coneept: A Warm Start,
  • Provisioned Concurrency,
  • How Provisioned Concurrency works,
  • Benefits Provisioned Concurrency,
  • Costs for Provisioned Concurrency,
  • When to Use Provisioned Concurrency,
  • Cold Start vs. Provisioned Concurrency Flow,
  • Optimization Without Provisioned Concurrency (If PC cost isn’t justified).
Intro:

  • twtech Overview of Lambda Cold Start, Warm start and Provisioned Concurrency in AWS.
  • This include when they happen, and how to control them.

1. The concept:  A Cold Start

  • A cold start happens when AWS Lambda needs to create a new execution environment before twtech function can run.
It happens when:

  • A function is invoked for the first time.
  • AWS has scaled up concurrency (new instances).
  • An execution environment has been inactive long enough that AWS reclaims it.

Cold start process:

  1. Download & load code (from S3 or ECR).
  2. Create runtime container (Node.js, Python, Java, etc.).
  3. Initialize environment (init phase — run global/static code, import libraries).
  4. Invoke handler (twtech actual function logic starts).

How Cold starts adds extra latency:

  • Java, .NET, large packages → 500ms to multiple seconds.
  • Python, Node.js, Go → typically 50–300ms.

2. The coneept:  A Warm Start.

  • If an execution environment is already running (within the idle retention window), Lambda just reuses it.
    • No container creation → near-instant start.
    • Warm start latency: ~1–10ms (depends on function logic).

3. Provisioned Concurrency

  • Provisioned Concurrency (PC) keeps execution environments pre-initialized and ready to respond instantly.
How Provisioned Concurrency works:
    • twtech configures N-provisioned concurrency instances for its function or alias.
    • AWS keeps them warm 24/7.
    • Requests first go to these pre-warmed instances before falling back to on-demand capacity (which may cause cold starts).
  • Benefitsof Provisioned Concurrency:
    • Eliminates cold starts for predictable workloads.
    • Keeps latency consistent.
  • Costs for Provisioned Concurrency:
    • twtech pays for:
      1. Provisioned concurrency hours (like reserved compute).
      2. Invocations (normal Lambda cost).

4. When to Use Provisioned Concurrency

✅  API endpoints where latency matters.
✅  Scheduled jobs with tight Service Level Aggreements
(SLAs).
✅  High-traffic Periods 
(Black Friday, Prime-week, product launches).
❌  Sporadic, low-frequency functions (waste of cost).

5. Cold Start vs. Provisioned Concurrency Flow

Feature

Cold Start

Provisioned Concurrency

Init time.

50ms–3s+

~0ms

Latency impact.

Yes, first request after idle

None

Cost.

Pay only for execution

Pay for warm capacity + execution

Scaling.

On-demand

Pre-allocated

Use case.

Sporadic jobs

Predictable latency workloads

6. Optimization Without Provisioned Concurrency (If PC cost isn’t justified):

  • Keep functions small (minimize package size).
  • Choose fast runtimes (Python/Node.js > Java/.NET for startup).
  • Avoid heavy init in global scope (lazy-load inside handler).
  • Use Lambda SnapStart (Java only) to snapshot pre-initialized state.
  • Send periodic “keep warm” pings (CloudWatch scheduled events).


No comments:

Post a Comment

Databases Explained & Use Cases with (Flash Card) | Overview.

Databases Explained  & Use Cases ( Flash Cards)   - Overview. A database is a structured collection of digital information designed f...