Learn how AI coding agents can expose credentials in supply chain attacks and how Docker Sandboxes keep secrets out of an agent's reach.
#engineering
503 posts (showing latest 300 - use search for the rest)
Today
Yesterday
Informational only, not legal advice. Confirm all regulatory details against the...
Pinner Progression: Better Use-Case Representation Driving Weekly Active User Growth at Pinterest
PinterestPart 1 of 2 Authors Personalization (Homefeed): Yuke Yan, Chuxi Wang, Andreanne Lemay, Olafur Gudmundsson, Anna Kiyantseva, Krystal Benitez, Jongho Kim, Jiacong He, Rahul Goutam, James Li, Dylan Wang User Understanding: Simin Li, Sufyan Suliman, Yingjian Ding, Hongbo Deng Data Science: Armando Ordorica, Yan Chen, Ellie Zhang, Karim Wahba Introduction Pinterest’s mission is to help people discover the inspiration to…
22 Jul
IntroductionTraditionally, auditing is a tedious process that often requires detailed...
Making large pricing changes safe to run, safe to resume, and safe to undo. Most days, shipping code to production at Thumbtack is a non-event. You merge your change, a deployment pipeline takes it from there and it rolls out while you monitor the rollout. If a deploy stalls, the system already knows which step it stalled on. If it…
Securing Infrastructure at Scale: Introducing Pinterest’s Resource Provisioner Pipeline (RPP)
PinterestAmmar Ekbote | Senior Software Engineer Chan Kim | Senior Software Engineer Managing Infrastructure as Code (IaC) across a massive organization comes with a unique set of security and logistical challenges, particularly when operating within a distributed, multi-repository architecture. At Pinterest, we designed the Resource Provisioner Pipeline (RPP) , our specialized, proprietary Terraform execution engine to safely manage both critical…
21 Jul
The setupAt cellcentric, a joint venture of Daimler Truck and Volvo Group, we develop...
How we built a Transformer-based sequence model that encodes years of guest behavior to surface the right listings at the right time. By: Daochen Zha , Chun How Tan , Xin Liu , Bin Xu , Han Zhao , Xiaowei Liu , Jun Shi , Tracy Yu , Hui Gao , Huiji Gao , Liwei He , Michael Kinoti ,…
20 Jul
A look at compensating for position bias in recommender systems using negative sampling strategies By: Andrew Morss, Senior Applied Scientist Introduction A recommender system is a machine learning model that, given a user and a catalog of items, predicts which items that user is most likely to want. Recommenders set your YouTube playlist, determine what items Amazon suggests for you,…
Across Databricks, thousands of customers build production workloads that map freeform...
17 Jul
Tracking data is now the richest signal in sport, but the real gap is turning the...
16 Jul
Moving fast should not mean breaking things for your users. While testing on localhost is a good start, you need a near identical replica of production to catch any bugs before your code goes live. That is where a staging environment comes in. Heroku pipelines handle the infrastructure layout for you, keeping your deployment workflow clean and automated. The post…
You're standing at the register. You tap your card. A tiny spinner appears for maybe...
Learn what AI agents are, how they work, and what it takes to build and run them safely in production.
IntroductionApache Spark 4.2 moves more of the modern data and AI stack into the...
14 Jul
Training an LLM is the easy part. The hard part is designing experiments and evaluations that you can trust enough to know whether the new model is actually an improvement. By : Baharak Saberidokht Introduction Shipping a production LLM system means iterating fast on improvements to something that is, by construction, non-deterministic. Models drift, judges disagree with themselves, references regenerate…
8 Jul
Azure Synapse has served as a reliable foundation for SQL analytics at scale, and...
1 Jul
Distributed GPU training has become routine across the industry. Teams now train...
Beginning in version 11.8.0, we will be improving the security of the Heroku CLI by storing authentication credentials in your system keychain by default. The Heroku credential manager makes use of OS-native secure storage tools with interfaces designed for sensitive data while maintaining compatibility with existing developer workflows. We began the transition to our new […] The post Securing Heroku…
30 Jun
When I started my PhD at UC Berkeley 16 years ago, my advisor told me: "OLTP databases...
OpenAI engineers used large-scale core dump analysis to debug rare infrastructure crashes, uncovering both a hardware fault and a long-standing software bug.
26 Jun
A utility company deploys drones to inspect hundreds of miles of power lines. A police...
Your team has hundreds of stored procedures, a couple of schedulers, permissions...
25 Jun
1. Introduction - Impulse: time-series analytics for measurement dataA single automotive...
Sheng Huang | Software Engineer, AI Platform; Pong Eksombatchai | Machine Learning Engineer, Applied Sciences; Saurabh Vishwas Joshi | Software Engineer, AI Platform; Gaurav Arora | Software Engineer, AI Platform; Karthik Anantha Padmanabhan | Engineering Director, AI Platform At Pinterest, foundation models power recommendations for over 600 million monthly active users. Our latest Foundation Model (ACM RecSys 2025) pre-trains on…
24 Jun
Yisheng Zhou | Software Engineer II Liang Mou | Sr Staff Software Engineer Gabriel Raphael Garcia Montoya | Staff Software Engineer Istvan Podor | Staff Software Engineer Introduction In the first post of this series , we introduced Pinterest’s next-generation CDC-based ingestion platform built on Kafka, Flink, Spark, and Iceberg. In production, upstream schemas are constantly evolving, and in a…
Agentic data engineering is changing how pipelines are builtDaikin Applied Americas...
Heroku Connect is a fully managed, bidirectional data sync service between Salesforce and Heroku Postgres that lets developers read and write Salesforce data using standard SQL. The sync is straightforward to set up and operates smoothly in the background, but when a field does not update as expected or data seems to lag, you do not need to guess what…
18 Jun
We break down the technical architecture behind our multi-stage vulnerability discovery harness and automated triage loop. Learn how we manage state controls, squash false positives through adversarial review, and route around LLM context limits.
The identity matching problem brands face todayBrands invest heavily in building first-party data assets...
In Part 1, we walked through six categories of AI coding agent failures and why they keep happening. The agent runs as you, with your filesystem permissions and your credentials, and nothing sits between the model's decision and the shell's execution. In Part 2, we looked at one specific version of that failure in detail,...
Last year, SoundCloud upgraded its AAC encoder for the first time in over a decade. The new one (Fraunhofer’s libfdk_aac) delivers higher…
Last year, SoundCloud upgraded its AAC encoder for the first time in over a decade. The new one (Fraunhofer’s libfdk_aac) delivers higher…
16 Jun
Sciene develops AI products that standardize and scale high-volume, relationship-centered...
12 Jun
Cloudflare Security Insights system now processes over 120 scans per second, providing frequent insights for all customers. By optimizing Kafka consumers, Postgres queries, and our API, we scaled our throughput 10x without adding hardware.
11 Jun
Telemetry data is everywhere. IoT sensors on factory floors. Satellite arrays scanning...
10 Jun
Challenges of Running Custom Model InferencesWhen you deploy a machine learning model to production...
4 Jun
How Airbnb built a Kubernetes sidecar to deliver dynamic configuration reliably at scale. By : Bo Teng , Cosmo Qiu , Siyuan Zhou , Ankur Soni , Xin Huang , Willis Harvey Introduction In our previous post , we explored Airbnb’s dynamic configuration system, Sitar, with a focus on service architecture and configuration change safety. Now for the harder question:…
1 Jun
We investigated why firmware updates were causing our core servers to take four hours to reboot. By diving into UEFI data structures and iPXE automation, we eliminated unnecessary timeouts and cut boot times back down to minutes.
28 May
Here’s how we built Town Lake, Cloudflare's unified analytics platform, alongside Skipper, an internal AI agent running on top of it.
27 May
CVE-2026-31431 is a Linux kernel vulnerability that was recently disclosed. This CVE does not compromise Docker infrastructure. That said, Docker Engine's default profiles prior to v29.4.3 allowed containers to create AF_ALG sockets, which is the syscall surface the exploit uses. You are not exposed if you are running Docker Engine v29.4.3 or later, OR a...
See how OpenAI, Thrive, and Crete built a self-improving tax agent with Codex, automating filings, improving accuracy, and accelerating workflows.
26 May
Authors: Auriane Bonmarchand , Carolina Tealdo & Minh-Quyên NGUYEN In our previous post , we explained the Engineering Program Manager role at Criteo at a high level: EPMs sit at the intersection of business ambition, technical reality, and execution, helping complex cross-team initiatives move from intent to delivery. But if you are considering this role, that high-level description is only…
22 May
Over the past year, the way we use AI at Thumbtack has gone through a few phases. Early on it was mostly curiosity, people experimenting with ChatGPT and Copilot on side projects, sharing tips in Slack. Then the models got noticeably better at working inside real, mature codebases (not just greenfield projects) and the conversation shifted. It stopped being about…
21 May
Authors ( listed alphabetically ) Ads Feature Engineering Infra team: Ajay Venkatakrishnan, Le Zhang Core ML Infra team: Eric Shang, Pihui Wei ML Data team: Connor Votroubek, Yi He User Understanding team: Camilo Munoz, Simin Li If you work on ranking, retrieval, or recommendation systems, you’ve probably asked for some version of the same thing: “Give me the last N…
19 May
How Airbnb shifts from PaaS to an internal knowledge graph infrastructure at scale. By: Lucen Zhao , Shukun Yang , Ashish Jain Knowledge graphs offer a natural and powerful way to represent relationships between entities. Many real-world systems are fundamentally about connections. Airbnb’s identity graph captures relationships between users in a graph database. The identity graph serves aggregated insights that…
18 May
This is issue 1 of a new series called Coding Agent Horror Stories where we examine critical security failures in the AI coding agent ecosystem and how Docker Sandboxes provide enterprise-grade protection against these threats. AI coding agents are everywhere. According to Anthropic's 2026 Agentic Coding Trends Report, developers are now using AI in roughly...
14 May
Our billing pipeline was suddenly slow. The culprit was a hidden bottleneck in ClickHouse
CloudflareWhen a partitioning change to our petabyte-scale ClickHouse cluster caused critical billing jobs to stall, standard metrics showed no obvious errors. This post explores how we identified severe lock contention in ClickHouse's query planner and built upstream patches to fix it.
13 May
Moving from an internal tool to a community-driven, production-ready data mesh. By : Ryan Tanner , Raymie Stata , Adam Miskiewicz Introduction We’re excited to announce the 1.0 release of the Viaduct. This release marks a shift from Viaduct being an Airbnb-internal tool that happens to be open source to a true community-driven project with a stable public API. The…
Learn how OpenAI built a safe, effective sandbox to enable Codex on Windows with controlled file access and network limits.
12 May
An Engineer’s Guide to Better AI Skills: Implementing a Testing Process to Optimize Agent…
PinterestAn Engineer’s Guide to Better AI Skills: Implementing a Testing Process to Optimize Agent Performance in Any Repository or Skill Author: Daniel Reed The tech industry is currently seeing a massive overhaul in the way we work and many are enjoying the benefits of AI agents, particularly when automating engineer workflows and serving domain-specific knowledge. However, relying on agents to…
8 May
Huiqin Xin | Machine Learning Engineer II, Ads Vertical Modeling; Lakshmi Manoharan | Senior Machine Learning Engineer, Ads Vertical Modeling; Karthik Jayasurya | Staff Machine Learning Engineer, Ads Signals; Ziwei Guo | Senior Machine Learning Engineer, Ads Vertical Modeling; Alina Liviniuk | Machine Learning Engineer II, Ads Vertical Modeling Motivation: The Need for Real-Time Context In a previous post ,…
6 May
How we replaced Ingress-NGINX at Stack Overflow
Stack OverflowIngress-NGINX had been handling our traffic routing since moving to Kubernetes, but when it was announced it would be retired, we were forced to consider a new traffic routing solution. …
5 May
Designing monitoring that works when everything else doesn’t. By : Abdurrahman J. Allawala Introduction When an incident hits, teams lean on observability to answer the only questions that matter: what’s broken, and why? Monitoring systems are designed to help you answer these questions, and they usually do. But what happens when your observability stack is dependent on the same systems…
Unlocking large scale AI training networks with MRC (Multipath Reliable Connection)
OpenAI EngineeringOpenAI introduces MRC (Multipath Reliable Connection), a new supercomputer networking protocol released via OCP to improve resilience and performance in large-scale AI training clusters.
4 May
How OpenAI rebuilt its WebRTC stack to power real-time Voice AI with low latency, global scale, and seamless conversational turn-taking.
1 May
Guangtong Bai | Staff Software Engineer, Product ML Infrastructure*; Shantam Shorewala | Software Engineer II, Product ML Infrastructure*; Chi Zhang | Staff Software Engineer, AI Platform*; Neha Upadhyay | Software Engineer II, AI Platform*; Haoyang Li | Director, Product ML Infrastructure *These authors contributed equally to this article. Background At Pinterest, our online ML serving systems employ a root-leaf architecture.…
A Virtual Agent team at Docker: How the Coding Agent Sandboxes team uses a fleet of agents to ship faster
DockerI work on Coding Agent Sandboxes, aka “sbx” at Docker. The project provides secure, microVM-based isolation for running AI coding agents like Claude Code, Gemini, Codex, Docker Agent and Kiro. Agents get full autonomy inside a sandbox (their own Docker daemon, network, filesystem) without touching your host system. Over the past couple of weeks, we...
28 Apr
How Airbnb built a lightweight workflow engine to solve durable execution. By : Ricardo Gamba , Andriy Sergiyenko Introduction: The durable execution problem Picture this hypothetical flow: A host submits an insurance claim about their listing to Airbnb. The system needs to validate the claim, run trust and safety checks, assess estimates, process the payout, and send notifications. Halfway through…
27 Apr
From Clicks to Conversions: Architecting Shopping Conversion Candidate Generation at Pinterest
PinterestAuthors: Richard Huang | Machine Learning Engineer II; Yu Liu | Senior Machine Learning Engineer; Ziwei Guo | Senior Machine Learning Engineer; Andy Mao | Staff Machine Learning Engineer; Supeng Ge | Sr. Staff Machine Learning Engineer Introduction At Pinterest, conversion ads are crucial for matching users with products they are likely to purchase, boosting value for both users and…
Learn how Symphony, an open-source spec for Codex orchestration, turns issue trackers into always-on agent systems—boosting engineering output and reducing context switching.
22 Apr
A deep dive into the Codex agent loop, showing how WebSockets and connection-scoped caching reduced API overhead and improved model latency.
Authors: Auriane Bonmarchand , Carolina Tealdo & Minh-Quyên NGUYEN At Criteo, Engineering Program Managers (EPMs) sit at the heart of our most complex, cross-team initiatives. We connect business ambition with technical reality, helping engineering teams ship impactful products at scale. In this article, three EPMs share what the role really looks like, why we love it, and how your career…
21 Apr
How we built a storage system that ingests 50 million samples per second and stores 2.5 petabytes of logical time series data. By : Rishabh Kumar Modern observability practice encourages instrumenting every meaningful code path. Over the past 15 years, open-source observability SDKs like Prometheus, OpenTelemetry, and StatsD have made deep instrumentation nearly ubiquitous. These days, most software — open-source…
20 Apr
Shanhai Liao | Senior Software Engineer, Content Acquisition and Media Platform; Di Ruan, | Senior Staff Software Engineer, Content Acquisition and Media Platform; Evan Li, | Senior Engineering Manager, Content Acquisition and Media Platform Introduction Accurate content understanding underpins Pinterest’s ability to drive distribution and engagement. This requires deep insight not just into the image itself, but also the outbound…
16 Apr
Last week, we launched Docker Sandboxes with a bold goal: to deliver the strongest agent isolation in the market. This post unpacks that claim, how microVMs enable it, and some of the architectural choices we made in this approach. The Problem With Every Other Approach Every sandboxing model asks you to give something up. We...
15 Apr
Vaibhav Shankar; Staff Software Engineer | Raymond Lee; Staff Software Engineer | Chia-Wei Chen; Staff Software Engineer | Shunyao Li; Sr. Software Engineer | Yi Li; Staff Software Engineer | Ambud Sharma; Principal Engineer | Saurabh Vishwas Joshi; Principal Engineer | Charles-A. Francisco; Senior Engineer | Karthik Anantha Padmanabhan; Director, Engineering | David Westbrook; Sr. Manager, Engineering One day in…
14 Apr
Discover how Airbnb prioritizes user privacy while building a more connected community, empowering guests to engage socially, connect confidently, and maintain control of their personal data. By: Joy Jing ✨ Building a more connected community At Airbnb, our hosts and guests form the heart of our community. As shared by CEO Brian Chesky , we’re evolving into a more social…
13 Apr
Authors: Matt Lawhon | Sr. Machine Learning Engineer; Filip Ryzner | Machine Learning Engineer II; Kousik Rajesh | Machine Learning Engineer II; Chen Yang | Sr. Staff Machine Learning Engineer; Saurabh Vishwas Joshi | Principal Engineer At Pinterest, scaling our recommendation models delivers outsized impact on the quality of the content we serve to users. Our Foundation Model (oral spotlight,…
This post is a collaboration between Docker and Arm, demonstrating how Docker MCP Toolkit and the Arm MCP Server work together to scan Hugging Face Spaces for Arm64 Readiness. In our previous post, we walked through migrating a legacy C++ application with AVX2 intrinsics to Arm64 using Docker MCP Toolkit and the Arm MCP Server...
8 Apr
Author: Lin Wang (Android Performance Engineer) Default Feature For mobile apps, performance is considered as the “default feature”, which means apps are expected to run fast and be responsive. It’s just as if we expect a watch to show the time. With no exceptions at Pinterest, we measure, protect and improve performance for all of our key user experiences’ surfaces,…
7 Apr
A production-tested approach for moving a large-scale metrics pipeline from StatsD to OpenTelemetry and Prometheus. By: Eugene Ma , Natasha Aleksandrova When migrating to a new monitoring system, you’ll want to frontload the work to collect all your metrics. This exposes bottlenecks at full write scale and unblocks the migration of assets which require real data for validation, such as…
Homefeed: Jiacong He, Dafang He, Jie Cheng (former), Andreanne Lemay, Mostafa Keikha, Rahul Goutam, Dhruvil Deven Badani, Dylan Wang Content Quality: Jianing Sun, Qinglong Zeng ML Serving: Li Tang Introduction In feed recommendation, we recommend a list of items for the user to consume. It’s typically handled separately from the ranking model where we give probability predictions of user-item pairs.…
31 Mar
Back in October, we showed how Docker Model Runner on the NVIDIA DGX Spark makes it remarkably easy to run large AI models locally with the same familiar Docker experience developers already trust. That post struck a chord: hundreds of developers discovered that a compact desktop system paired with Docker Model Runner could replace complex...
17 Mar
Most developers never see the 11 pack releases we shipped in the last 14 months as pack CLI maintainers. That’s actually a good sign—it means the infrastructure just works. When a critical vulnerability emerges requiring an immediate upgrade, the fix is shipped within days. Here’s what most developers don’t see: that same security patch now […] The post Behind the…
13 Mar
End-to-end (E2E) tests are particularly important for native applications that run on various platforms (Android/iOS), screen sizes, and OS versions. E2E testing picks up differences in behavior across this fragmented ecosystem. But keeping E2E tests reliable is often more challenging than writing them in the first place. The fragmented device ecosystem, gaps in test frameworks,...
12 Mar
Modern applications on Heroku don’t just consist of code. They are living ecosystems comprised of dynos, databases, third-party APIs, and complex user interactions. As these systems scale, so do the logs and metrics. To efficiently extract the signals from the noise you need to understand system health in the context of external factors, like resource […] The post From Fragmented…
11 Mar
How OpenAI built an agent runtime using the Responses API, shell tool, and hosted containers to run secure, scalable agents with files, tools, and state.
23 Feb
Docker Sandboxes is a new primitive in the Docker's ecosystem that allows you to run AI agents or any other workloads in isolated micro VMs. It provides strong isolation, convenient developer experience and a strong security boundary with a network proxy configurable to deny agents connecting to arbitrary internet hosts. The network proxy will also...
19 Feb
Special thanks to Cody Ebberson and the Medplum team for their open-source contribution and for sharing their migration experience with the community. A real-world example of migrating a HIPAA-compliant EHR platform to DHI with minimal code changes. Healthcare software runs on trust. When patient data is at stake, security isn't just a feature but a...
16 Feb
Ever wanted to run a personal AI assistant that monitors your WhatsApp messages 24/7, but worried about giving it access to your entire system? Docker Sandboxes' new shell sandbox type is the perfect solution. In this post, I'll show you how to run NanoClaw, a lightweight Claude-powered WhatsApp assistant, inside a secure, isolated Docker sandbox....
13 Feb
If you’ve ever debugged a production incident, you know the drill: IDE on one screen, Splunk on another, Sentry open in a third tab, frantically copying error messages between windows while your PagerDuty keeps buzzing. You ask “What errors spiked in the last hour?” but instead of an answer, you have to context-switch, recall complex […] The post Building AI-Powered…
How OpenAI built a real-time access system combining rate limits, usage tracking, and credits to power continuous access to Sora and Codex.
11 Feb
By Ryan Lopopolo, Member of the Technical Staff
10 Feb
Docker Hardened Images are now free, covering Alpine, Debian, and over 1,000 images including databases, runtimes, and message buses. For security teams, this changes the economics of container vulnerability management. DHI includes security fixes from Docker’s security team, which simplifies security response. Platform teams can pull the patched base image and redeploy quickly. But free...
5 Feb
A Q&A with Brett Shouse, Senior Software Engineer. As an engineer, what drew you to Thumbtack? I joined Thumbtack in March of 2025, and from day one it’s felt like the right place to grow, build, and make a real impact. I was ready for a fresh challenge and wanted to help evolve a business that truly aligned with my…
4 Feb
We’re excited to announce that the remote Atlassian Rovo MCP server is now available in Docker’s MCP Catalog and Toolkit, making it easier than ever to connect AI assistants to Jira and Confluence. With just a few clicks, technical teams can use their favorite AI agents to create and update Jira issues, epics, and Confluence...
Learn how to embed the Codex agent using the Codex App Server, a bidirectional JSON-RPC API powering streaming progress, tool use, approvals, and diffs.
Every time execution models change, security frameworks need to change with them. Agents force the next shift. The Unattended Laptop Problem No developer would leave their laptop unattended and unlocked. The risk is obvious. A developer laptop has root-level access to production systems, repositories, databases, credentials, and APIs. If someone sat down and started using...
3 Feb
Hostinger server unauthorized access case: What happened with Notepad++ and what measures we took to resolve it
HostingerWhat happened and what was affected? On December 1, 2025, we identified suspicious activity on one of our servers where our clients’ websites were hosted. After investigation, … The post Hostinger server unauthorized access case: What happened with Notepad++ and what measures we took to resolve it appeared first on Hostinger Blog.
30 Jan
We introduced Docker Sandboxes in experimental preview a few months ago. Today, we’re launching the next evolution with microVM isolation, available now for macOS and Windows. We started Docker Sandboxes to answer the question: How do I run Claude Code or Gemini CLI safely? Sandboxes provide disposable, isolated environments purpose-built for coding agents. Each agent...
29 Jan
If you’ve built a RAG (Retrieval Augmented Generation) system, you’ve probably hit this wall: your vector search returns 20 documents that are semantically similar to the query, but half of them don’t actually answer it. A user asks “how do I handle authentication errors?” and gets back documentation about authentication, errors, and error handling in […] The post Building AI…
How OpenAI built an in-house AI data agent that uses GPT-5, Codex, and memory to reason over massive datasets and deliver reliable insights in minutes.
23 Jan
A technical deep dive into the Codex agent loop, explaining how Codex CLI orchestrates models, tools, prompts, and performance using the Responses API.
22 Jan
FIPS compliance is a great idea that makes the entire software supply chain safer. But teams adopting FIPS-enabled container images are running into strange errors that can be challenging to debug. What they are learning is that correctness at the base image layer does not guarantee compatibility across the ecosystem. Change is complicated, and changing...
An inside look at how OpenAI scaled PostgreSQL to millions of queries per second using replicas, caching, rate limiting, and workload isolation.
16 Jan
Hello, I’m Philippe, and I am a Principal Solutions Architect helping customers with their usage of Docker. I started getting seriously interested in generative AI about two years ago. What interests me most is the ability to run language models (LLMs) directly on my laptop (For work, I have a MacBook Pro M2 max, but...
8 Jan
The large language model (LLM) race is accelerating, with new architectures, fine-tunes, and specialized systems arriving before the last ones have even settled. With such intense… The post LLMs under the hood of Hostinger Horizons: Balancing performance, speed, and cost appeared first on Hostinger Blog.
6 Jan
AI agents introduce a challenge that traditional software doesn’t have: non-determinism. The same prompt can produce different outputs across runs, making reliable testing difficult. Add API costs and latency to the mix, and developer productivity takes a hit. Session recording in cagent addresses this directly. Record an AI interaction once, replay it indefinitely—with identical results,...
14 Dec 2025
Most discussions about Model Context Protocol infrastructure ask how to govern thousands of AI tools and monitor which MCP servers are running. This question is table stakes but undershoots the possibilities. A better question is how we can unleash MCP to drive developer creativity from a trusted foundation. The first question produces a phone book...
12 Dec 2025
Insider threats have always been difficult to manage because they blur the line between trusted access and risky behavior. With generative AI, these risks aren't tied to malicious insiders misusing credentials or bypassing controls; they come from well-intentioned employees simply trying to get work done faster. Whether it's developers refactoring code, analysts summarizing long reports,...
OpenAI shipped Sora for Android in 28 days using Codex. AI-assisted planning, translation, and parallel coding workflows helped a nimble team deliver rapid, reliable development.
9 Dec 2025
Today, the Linux Foundation launched the Agentic AI Foundation with three founding projects: Anthropic's Model Context Protocol (MCP), Block's goose agent framework, and OpenAI's AGENTS.md standard. The foundation brings together the companies building the infrastructure layer for agents: Anthropic, Block, OpenAI, Amazon, Google, Microsoft, Cloudflare, and Bloomberg, alongside key tooling and platform companies. Docker is...
5 Dec 2025
As agents become capable enough to write and refactor code, they should work natively inside the environments developers work in: editors. That’s why JetBrains and Zed are co-developing ACP, the Agent Client Protocol. ACP gives agents and editors a shared language, so any agent can read context, take actions, and respond intelligently without bespoke wiring...
4 Dec 2025
For modern enterprises building cloud-native applications, success hinges on achieving maximum development velocity at every scale. Infrastructure as a Service (IaaS) providers like AWS provide hundreds of services with the unmatched reliability and scale needed for enterprise infrastructure, but they can require significant effort and expertise for organizations to be effective and efficient. To achieve […] The post PaaS +…
3 Dec 2025
Meet Ashmann Syngle, Software Engineer I joined Thumbtack in July 2022, so it’s been just over three years now! I first heard about the company from my former engineering manager at HBO Max, who encouraged me to apply. I’m so glad he did. What I’m Working On Over the past year, I’ve worked on several projects that make it easier…
25 Nov 2025
Coding agents like Claude Code, Gemini CLI, Codex, Kiro, and OpenCode are changing how developers work. But as these agents become more autonomous with capabilities like deleting repos, modifying files, and accessing secrets, developers face a real problem: how do you give agents enough access to be useful without adding unnecessary risk to your local...
21 Nov 2025
On November 19, 2025, the Golang project published two Common Vulnerabilities and Exposures (CVEs) affecting the widely-used golang.org/x/crypto/ssh package. While neither vulnerability received a critical CVSS score, both presented real risks to applications using SSH functionality in Go-based containers. CVE-2025-58181 affects SSH servers parsing GSSAPI authentication requests. The vulnerability allows attackers to trigger unbounded memory...
When I started incorporating AI tools into my workflow, I was first frustrated. I didn't get the 5x or 10x gains others raved about on social. In fact, it slowed me down. But I persisted. Partly because I see it as my professional duty as a software engineer to be as productive as possible, partly...
13 Nov 2025
At Thumbtack, collaboration has always been our edge; it’s what allows our teams to move fast, think creatively, and solve complex problems together. Our Decide & Resolve team works to empower homeowners to confidently hire the best local service professionals through relevant and personalized recommendations. Recently, we’ve introduced a new cross-functional process that combines the power of AI, accessible tooling,…
11 Nov 2025
This post is for Linux users running Docker Engine (Community Edition) directly on their hosts. Docker Desktop users don’t need to take any action — Engine updates are included automatically in future Desktop releases. Docker Engine v29 is a foundational release that sets the stage for the future of the Docker platform. While it may...
In just a year, the Model Context Protocol (MCP) has become the standard for connecting AI agents to tools and external systems. The Docker MCP Catalog now hosts hundreds of containerized local MCP servers, enabling developers to quickly experiment and prototype locally. We have now added support for remote MCP servers to the Docker MCP...
It’s that time of year for .NET when we get a new major version and a bunch of exciting features. .NET Conf 2025 kicked off earlier today, bringing with it the release of .NET 10, as well as ASP.NET Core 10, C# 14, and F# 10. Congrats (and a big thank you) to the .NET […] The post Heroku Support…
6 Nov 2025
The MCP protocol is almost one year old and during that time, developers have built thousands of new MCP servers. Thinking back to MCP demos from six months ago, most developers were using one or two local MCP servers, each contributing just a handful of tools. Six months later and we have access to thousands...
5 Nov 2025
Puma 7 is here, and that means your Ruby app is now keep-alive ready. This bug, which existed in Puma for years, caused one out of every 10 requests to take 10x longer by unfairly “cutting in line.” In this post, I’ll cover how web servers work, what caused this bad behavior in Puma, and […] The post Upgrade to…
Building an Enterprise Data Warehouse on Heroku: From Complex ETL to Seamless Salesforce Integration
HerokuModern businesses don’t just run on Salesforce—they run on entire ecosystems of applications. At Heroku, we operate dozens of services alongside our Salesforce instance such as billing systems, user management platforms, analytics engines, and support tools. Traditional approaches to unifying this data create more problems than they solve. In this article, we’ll see how we […] The post Building an…
4 Nov 2025
The Performance Penalty of Repeated Connections Before the latest improvements to the Heroku Router, every connection between the router and your application dyno risked incurring the latency penalty of a TCP slow start. To understand why this is a performance bottleneck for modern web applications, we must look at the fundamentals of the Transmission Control […] The post Learn How…
3 Nov 2025
One of the most exciting advances in modern AI is multimodal support, the ability for models to understand and generate multiple types of input, such as text, images, or audio. With multimodal models, you’re no longer limited to typing prompts; you can show an image or play a sound, and the model can understand it....
30 Oct 2025
Imagine this: Your sales team is about to close a major deal. They’re building a custom quote in your app, but they need to see the latest product line items from an Opportunity in Salesforce. They refresh. And wait. The data is stale. The quote gets generated, but it’s missing the latest addition to the […] The post Heroku Connect:…
A deep dive into OWL, the new architecture powering ChatGPT Atlas—decoupling Chromium, enabling fast startup, rich UI, and agentic browsing with ChatGPT.
9 Oct 2025
On October 7, 2025, we faced a disruption in our email service: some users were unable to receive mail and access mailboxes due to an unexpected technical problem in our storage s… The post Deep dive into our October 7 email outage: Causes, fixes, and what’s next appeared first on Hostinger Blog.
7 Oct 2025
It’s mid 2023 and we’ve identified some opportunities to improve our reliability. Fast forward to January 2025. Customer impact hours are reduced from the peak by 90% and continuing to trend downward. We’re a year and half into the Deploy Safety Program at Slack, improving the way we deploy, uplifting our safety culture and continuing…
10 Sept 2025
Salesforce customers often leverage third-party or custom services to extend their orgs, and they do so with two common options: Connected Apps and External Services. Connected Apps let third-party vendors or custom code call Salesforce APIs using long-lived OAuth tokens, while External Services call vendor APIs through declarative configurations with vendor-managed hosting, scaling, and endpoint security. While both approaches deliver…
8 Sept 2025
When Production Goes Sideways Imagine this: It’s 2 AM, your phone buzzes with an alert, and your dashboards are screaming. Production is down. Sound familiar? An automated health check has failed, and your internal dashboards are showing a spike in errors. You’ve just pushed a new release that included a critical database schema change, and […] The post Triage and…
26 Aug 2025
Building intelligent applications requires powerful, cost-effective AI. Today, we’re simplifying that process by making Amazon’s cutting-edge Nova models directly available via Heroku Managed Inference and Agents. Provisioning these models is as simple as attaching the add-on to your Heroku application, providing a direct, managed path for developers and businesses to leverage a new class of […] The post Amazon Nova…
20 Aug 2025
Start building with OpenAI’s new open-weight model, gpt-oss-120b, now available on Heroku Managed Inference and Agents. This gives developers a powerful, transparent, and flexible way to build and deploy AI applications on the platform they already trust. Access gpt-oss-120b with our OpenAI-compatible chat completions API, which you can drop into any OpenAI-compatible SDK or framework. […] The post Heroku AI…
19 Aug 2025
Building AI applications that can interact with private data is a common goal for many organizations. The challenge often lies in connecting large language models (LLMs) with proprietary datasets. A combination of Heroku Managed Inference and Agents and LlamaIndex provides an elegant stack for this purpose. This post explores how to use these tools to […] The post Building Data-Aware…
31 Jul 2025
This blog series has taken you on a journey through the world of AppLink, from its foundational concepts and core components in Heroku AppLink: Extend Salesforce with Any Programming Language, to a deep dive into its key integration patterns in AppLink Fundamentals I: AppLink Integration Patterns – Connecting Salesforce to Heroku Applications, and then we […] The post AppLink Fundamentals…
30 Jul 2025
In our previous posts, we introduced Heroku AppLink and explored its foundational integration patterns for connecting Heroku applications with Salesforce. Now, we’ll delve into how AppLink truly expands Salesforce capabilities, focusing on advanced integrations with Data Cloud, Flow, Apex, and Agentforce. This blog will highlight how AppLink empowers you to infuse your Salesforce orgs with […] The post AppLink Fundamentals…
29 Jul 2025
AppLink Fundamentals I: AppLink Integration Patterns – Connecting Salesforce to Heroku Applications
HerokuIn our previous post, we introduced AppLink as a powerful new way to extend Salesforce with any programming language at any scale, detailing its core components and overarching benefits. Now, we’ll dive deeper into the practical application of AppLink by exploring its primary integration patterns. Understanding these patterns is key to leveraging AppLink effectively, as […] The post AppLink Fundamentals…
17 Jul 2025
The Salesforce platform offers a powerful array of tools for customization and building customer-centric experiences, from no-code automation with Flow, Prompt Builder, and Agent Builder, to robust Apex and Lightning Web Components. The art lies in choosing the right blend of these tools to achieve agility, optimize skill sets, and quickly adapt to business demands. […] The post Heroku AppLink:…
9 Jul 2025
Modern cloud-native architectures are composed of multiple microservices running across dynamic environments. Effectively diagnosing performance issues, bottlenecks, or failures requires comprehensive observability. For this, many organizations look to OpenTelemetry, which provides a standardized approach to capturing and analyzing telemetry data. Fir is Heroku’s next generation cloud platform, designed to offer more modern cloud-native capabilities with […] The post OpenTelemetry, Kubernetes,…
26 Jun 2025
How Blinkit Cracked Android's Performance Puzzle with Droid Dex Adaptive real-time performance tuning — fewer ANRs, smoother UX, and smarter device-specific optimization Picture this: Your app runs buttery-smooth on Pixel 7 Pro while throwing ANRs on a Redmi Note 4. Users on a Fold 6 have to experience the same janky transitions as those on a ₹6,000 device. Sounds familiar?…
5 Jun 2025
Serverless Container Framework v2 (SCF v2) makes it easy to deploy powerful AI agents on your own AWS infrastructure—integrating seamlessly with APIs, events, and Slack. Skip the PaaS limitations and build agents that actually fit your stack.
4 Jun 2025
Ah, another day, another deep dive into the ever-evolving world of Python development! Today, let’s talk about something near and dear to every Pythonista’s heart – managing those crucial external packages. For years, pip has been our trusty companion, the workhorse that gets the job done. But the landscape is shifting, and a new contender […] The post Local Speed,…
29 May 2025
If you’ve ever deployed an app on Heroku, chances are you’ve used Heroku Postgres — our fully managed, reliable, and scalable Postgres database service. It’s the backbone for millions of applications, from weekend side projects to enterprise-grade systems running in production. But Postgres, like all software, continues to evolve. With new versions released each year, […] The post Heroku Postgres…
27 May 2025
Heroku recently made the next generation platform – Fir – generally available. Fir builds on the strengths of the Cedar generation while introducing a new modern era of developer experience. Fir leverages modern cloud-native technologies to provide a seamless and performant platform. One of the goals we set out to achieve with Fir is to […] The post OpenTelemetry Basics…
22 May 2025
The speed and efficiency of the Go programming language make it popular for backend development. Combine Go with the Gin framework—which offers a fast and minimalistic approach to building web applications—and developers can easily create high-performance APIs and web services. Whether you’re working on a personal project or building a production-ready application, Go and Gin […] The post Deploying a…
21 May 2025
SignalR makes it easy to add real-time functionality to .NET web applications—things like live chat, instant notifications, or interactive dashboards. But what happens when your app starts to grow? A single server can only take you so far. At some point, you’ll need to take advantage of SignalR scaling features to scale out your app. […] The post SignalR Scalability:…
5 May 2025
Generative AI has been one incredible tool to improve my productivity not only for work but for personal projects too. I use it every day, from generating stories and images for my online role playing games to solving code and engineering problems and building awesome demos. Lately I’ve leaned into Cursor as my go‑to AI […] The post How I…
16 Apr 2025
With API-driven applications being increasingly common, understanding how your APIs are performing is crucial for success. That’s where the combination of Heroku and Moesif allows developers and their organizations to step up their observability game. In this blog, we will quickly examine how you can integrate Moesif with your Heroku app to begin monetizing and analyzing your API traffic. Let’s…
27 Mar 2025
Many advanced users want to use GitHub Actions with their applications on Heroku. Now there’s a straightforward way to use these great systems together, and to meet strong security and compliance requirements at the same time. A Solution for GitHub IP Range Restrictions Heroku is a powerful platform that offers robust CI/CD capabilities and secure, […] The post Using GitHub…
24 Mar 2025
Heroku’s commitment to developer productivity shines through in its powerful buildpack system. They handle the heavy lifting of building your app, letting you focus on what matters most: writing code. A prime example is the Heroku Java buildpack, a versatile tool that simplifies deploying Java applications, especially those built with popular frameworks like Spring Boot, […] The post Simplifying JVM…
17 Dec 2024
The Heroku CLI is a vital tool for developers, providing a simple, extensible way to interact with the powerful features Heroku offers. We understand the importance of keeping the CLI updated to enhance user experience and ensure stability. With the release of Heroku CLI v10, we’re excited to introduce key changes that enhance the user […] The post Heroku CLI…
2 Dec 2024
tl;dr: If your app doesn’t store SoundCloud access tokens outside of the context of a user’s client (i.e. a database) the following should…
21 Nov 2024
Update: Puma 7.0 was released with a fix for the bug described in this article. We recommend Ruby applications upgrade to Puma 7.0.4 or higher. This week, Heroku made Router 2.0 generally available, bringing features like HTTP/2, performance improvements and reliability enhancements out of the beta program! Throughout the Router 2.0 beta, our engineering team […] The post Pumas, Routers…
Heroku Router 2.0 is now generally available, marking a significant step forward in our infrastructure modernization efforts. The new router delivers enhanced performance and introduces new features to improve your applications’ functionality. There are, of course, nuances to be aware of with any new system, and with Router 2.0 set to become the default router […] The post Tips &…
17 Oct 2024
Heroku is a powerful general-purpose PaaS offering, but when combined with the broader Salesforce portfolio, it excels in unlocking and unifying customer data, regardless of its age, location, size, or structure. Salesforce customers turn to Heroku when they need to leverage high data volumes from sources such as consumer web or mobile apps or when […] The post How to…
24 Sept 2024
When building web applications, unit testing your individual components is certainly important. However, end-to-end testing provides assurance that the final user experience of your components chained together matches the expected behavior. Testing web application behavior locally in your browser can be helpful, but this approach isn’t efficient or reliable, especially as your application grows more […] The post Testing a…
26 Aug 2024
Optimize AWS Lambda observability with Axiom and Serverless Framework. Save on costs compared to AWS CloudWatch while enjoying seamless logs, metrics, and traces integration. Simple setup, advanced configuration, and non-disruptive transition for efficient serverless deployments.
22 Aug 2024
Data Residency Compliance Is Possible with the Right Cloud Provider Because today’s companies operate in the cloud, they can reach a global audience with ease. At any given moment, you could have customers from Indiana, Indonesia, and Ireland using your services or purchasing your products. With such a widespread customer base, your business data will […] The post What is…
15 Aug 2024
Modern applications have an unceasing buzz of user activity and data flows. Users send a flurry of one-click reactions to social media posts. Wearable tech and other IoT sensors work nonstop to transmit event data from their environments. Meanwhile, customers on e-commerce sites perform shopping cart actions or product searches which can bring immediate impact […] The post Building an…
29 Jul 2024
In today’s fast-paced digital world, companies are looking for ways to expose their APIs and microservices to the internet while enhancing their overall API security. MuleSoft Anypoint Flex Gateway is a powerful solution that solves this problem. Let’s walk through deploying the Anypoint Flex Gateway on Heroku in a few straightforward steps. You’ll learn how […] The post Mastering API…
25 Jul 2024
Introduction The Heroku CLI is an incredible tool. It’s simple, extendable, and allows you to interact with all the Heroku functionality you depend on day to day. For this reason, it’s incredibly important for us to keep it up to date. Today, we’re excited to highlight a major upgrade with the release of Heroku CLI […] The post Heroku CLI…
19 Jul 2024
What is pnpm? Pnpm is a fast, disk-efficient Node package manager used as an alternative to npm. The Heroku Node.js buildpack now supports pnpm. Early Node.js application owners who’ve taken advantage of pnpm support have seen 10-40% faster install times compared to NPM on Heroku deployments. It’s an excellent choice for managing packages in the […] The post How to…
26 Jun 2024
Heroku Connect makes it easy to sync data at scale between Salesforce and Heroku Postgres. You can build Heroku apps that bidirectionally share data in your Postgres database with your contacts, accounts, and other custom objects in Salesforce. Easily configured with a point-and-click UI, you can get the integration up and running in minutes without […] The post Optimizing Data…
9 May 2024
One of our most important goals at Heroku is to be boring. Don’t get us wrong, we certainly hope that you’re excited about the Heroku developer experience — as heavy users of Heroku ourselves, we certainly are! But, even more so, we hope that you don’t have to spend all that much time thinking about […] The post Evolving the…
29 Apr 2024
If you’re an API developer working with Node.js, then you’re probably familiar with Express. But have you tried out the Fastify framework to build with power, speed, and convenience? In this walkthrough, we build a full-featured, easy-to-consume API with Fastify. And we deploy it to the cloud with ease. We show you how to: Get […] The post Build Well-Documented…
24 Apr 2024
Bazaarvoice notification system stands as a testament to cutting-edge technology, designed to seamlessly dispatch transactional email messages (post-interaction email or PIE) on behalf of our clients. The heartbeat of our system lies in the constant influx of new content, driven by active content solicitations. Equipped with an array of tools, including email message styling, default […]
23 Apr 2024
Earlier this year, we updated our API Guide to let developers know that SoundCloud authentication is now operating on the OAuth 2.1 protocol…
18 Apr 2024
At Slack, we’ve long been conservative technologists. In other words, when we invest in leveraging a new category of infrastructure, we do it rigorously. We’ve done this since we debuted machine learning-powered features in 2016, and we’ve developed a robust process and skilled team in the space. Despite that, over the past year we’ve been…
9 Apr 2024
For developers and businesses offering a web-based product, automated browser testing is a critical tool to ensure continuous delivery of a reliable service. Developers write browser tests by scripting actions against a real browser, simulating real usage by navigating, selecting, and making assertions about web pages and their document elements. In this post, we introduce […] The post Improved Browser…
28 Mar 2024
How to connect your GPT on OpenAI to a backend Node.js app Late in 2023, OpenAI introduced GPTs, a way for developers to build customized versions of ChatGPT that can bundle in specialized knowledge, follow preset instructions, or perform actions like reaching out to external APIs. As more and more businesses and individuals use ChatGPT, […] The post Building a…
30 Jan 2024
How to Build and Deploy a Node.js App That Uses OpenAI’s APIs Near the end of 2023, ChatGPT announced that it had 100M weekly users. That’s a massive base of users who want to take advantage of the convenience and power of intelligent question answering with natural language. With this level of popularity for ChatGPT, […] The post Working with…
11 Dec 2023
Photo by fabio on Unsplash PayPal supports over 400 million active consumers and merchants worldwide. Every minute there are several thousand payment transactions. To prevent fraud in real-time at such a scale, we need to streamline our ML workflow and feature engineering processes to build strong predictors of behaviors and risk indicators. On top of that, it must be done…
16 Nov 2023
Introducing pgvector for Heroku Postgres Over the past few weeks, we worked on adding pgvector as an extension on Heroku Postgres. We’re excited to release this feature, and based on the feedback on our public roadmap, many of you are too. We want to share a bit more about how you can use it and […] The post How to…
30 Oct 2023
Last month, Heroku announced the beta release of Router 2.0, the new Common Runtime router! As part of our commitment to infrastructure modernization, Heroku is making upgrades to the Common Runtime routing layer. The beta release of Router 2.0 is an important step along this journey. We’re excited to give you an inside look at […] The post Router 2.0…
22 May 2023
Leveraging IoT to deliver printouts to your doorstep Setting up our Printout Delivery Store has been highly satisfying. At one end is the joy of customers discovering an easy, home-delivered solution for last-minute printouts. But even more enjoyable is the knowledge that we created a nationwide service with only a Raspberry Pi and a seamless print flow that effectively harnesses…
11 Apr 2023
In this post, we’d like to share an example of the kind of behind-the-scenes work that the Heroku team does to continuously improve the platform based on customer feedback. The Heroku Common Runtime is one of the best parts of Heroku. It’s the modern embodiment of the principle of computing resource time-sharing pioneered by John […] The post More Predictable…
13 Feb 2023
Storing Postman scripts within reusable components in an OpenAPI definition In programming, “hacking” has historically meant making something do what it wasn’t originally intended to do, like using a whistle from a cereal box prize to play the tone into a pay phone to get free long distance calls. Today, it also refers to finding an inelegant solution to a…
1 Feb 2023
And use Postman to send and receive messages across the WebSocket connection The WebSocket protocol provides a way to exchange data between a client and server over a persistent connection. The data can be passed in both directions with low latency and overhead, and without breaking the connection. This means the server can independently send data to the client without…
9 Jan 2023
Author: Darragh Burke, Software Engineer II, Web Development at Tinder Tinder’s UI Opportunities: Wildfire When Tinder first launched in 2012, it pioneered a brand new user experience: the Swipe Right® and “Swipe Left”™ features. The app’s simplicity was a big part of what made it so appealing. An early version of Tinder We’ve emphasized building new features and moving fast…
17 Nov 2022
The BBC’s Engineering teams develop and run our digital products at scale — ensuring our digital services are available and accessible to audiences that need them the most, and as as reliable as our broadcast ones. Recent times have tested the resilience of our teams and our services but we’ve delivered at every moment. Overcoming significant technical challenges and enabling…
7 Nov 2022
Authors: Rojan Rijal , Tinder Security Labs | Johnny Nipper, Product Security Manager | Tanner Emek, Engineering Manager Recently, Tinder Security Labs gave a talk at Recon Village @ Defcon 30 called “Scanning your way into internal systems via URLScan.” We went over examples of sensitive links indexed by URLScan that could be leveraged to gain access into corporate systems.…
28 Oct 2022
This post discusses the algorithm behind Personal Heatmap, one of Strava’s most acclaimed subscriber features. Product Overview The Personal Heatmap feature has been around in some form since 2015, but we gave it a major overhaul in 2020. For those unfamiliar, the heatmap is an aggregated view of an athlete’s GPS-enabled activities on Strava. Activity data is rendered onto a…
25 Oct 2022
About Me: Hey there! My name is Ryan, and I come from an unconventional background. I am not like most interns from the group in 2022. I’ve dropped out of college 3 times, worked in different fields for about 10 years, then transitioned into a bootcamp. Now working with Strava, they have set the expectation of what it should be…
In an earlier blog post, we talked about how we changed the interview process during remote working as a way of improving our recruiting…
3 Oct 2022
Internships are a great opportunity for companies to invest in great talent and train future engineers. It is important to prepare a good mentorship plan for the interns, so that they make the best use of their time and acquire experiences that will help make them full-time employees in the future. The first step is…
23 Sept 2022
What’s it like to be an engineer at Clever? What does success look like for individuals and teams? From engineers with non-traditional backgrounds to engineers with Computer Science degrees, four engineers share their perspectives about their experiences, typical days, and growth while working at Clever. The post Interviewing at Clever: Answers to the 10 most common questions appeared first on…
19 Sept 2022
We’ve seen considerable adoption of our internal humane registry, Services Directory, since we sanitized ownership definition and introduced…
2 Aug 2022
SoundCloud has a variety of resource groups, and one such group is called Women in Engineering, or WINE. The mission statement of the group…
26 Jul 2022
This blog post explains how to setup a welcome email flow using Serverless Cloud and Sendinblue.
2 Jun 2022
Serverless isn't just great for building stuff fast. It can also help point you in a direction that promotes some useful engineering practices. Anna shares with us 7 ways this happens!
19 May 2022
AI and Serverless work really well together. But not just for AI models. Serverless can also help you in deploying your models to make them available to your users.
18 May 2022
This is a walkthrough on how easy it is to use both Serverless Cloud and Upstash together to easily and quickly offer your users the app performance they deserve.
17 May 2022
In this article learn what serverless architecture is, 3 benefits to using it, and see examples of how it's being used.
13 May 2022
To wrap up the 5 part series, lets look more deeply into how to do automated testing of your Serverless application
12 May 2022
Part 4 of 5 with our series and its time to start implementing our architecture in code and configuration using some appropriate design patterns and following a Function as a Microservice style.
11 May 2022
In this 3rd part of our 5 part series about Java and Serverless, we design our full architecture and look at all the pieces in preperation for our code.
10 May 2022
When building Java based Serverless applications, testing locally can be handy. In part 2 of the series we find out how.
9 May 2022
Serverless and Java (using Kotlin) can be a great match. Juan spends the time this week showing us how with part 1 being all about setting up.
28 Apr 2022
In this article I'll introduce you to an amazing feature of Next.js called Incremental Static Regeneration (ISR) and show you how to enable it in your Serverless Cloud Next.js applications.
27 Apr 2022
Flask and Django are two popular WSGI frameworks to combine with Lambda. Michal shows us how to get up and running quickly, build your app and benefit from Lambda.
26 Apr 2022
Dealing with retry mechanisms can sometimes be a little tricky. Enrico gives us some tips on making the most of this Serverless characteristic.
25 Apr 2022
During my final search for an internship, I had an idea of where I wanted to work: a place with a friendly culture and strong engineering practices – something in between a startup and a big company. To my luck, I interned at Clever – an organization that surpassed those expectations in the span of […] The post Working at…
21 Apr 2022
Ever wondered how to deal with Python dependencies when using the Serverless Framework? Dorian shows us how smple it can really be!
20 Apr 2022
Serverless Cloud allows developers to build full-stack apps powered by SvelteKit and Serverless Cloud. Develop, build and deploy under a minute with Serverless Cloud
19 Apr 2022
I’m a backend developer who worked extensively writing code in Golang before joining SoundCloud. SoundCloud mostly uses Scala for its…
18 Apr 2022
Get your own web app up and running in about 15 minutes. You'll only need a basic understanding of AWS Lambda and some proficiency in JavaScript/TypeScript.
6 Apr 2022
AWS just released a brand new feature called "Lambda Function URLs", and we are happy to announce that Serverless Framework supports Lambda Function URLs immediately.
31 Mar 2022
ShreyTheCray interviews Gareth McCumskey as he walks through the purpose, use cases, and process of getting started with the Serverless framework
14 Mar 2022
This is the story of how we used the Strangler pattern to migrate our public API from a monolithic codebase to a fully fledged BFF over the…
7 Mar 2022
Changing the organisation — to build the technology right. In earlier blog posts, we explored how we moved BBC online to the cloud. This was part of a wider initiative called WebCore, which used a range of serverless technologies to reimagine the BBC website. There were technical challenges we faced integrating WebCore with our architecture , but this initiative has…
4 Mar 2022
Learn how to set up a Discord app that automatically adds songs to a Spotify playlist using Serverless Cloud.
25 Feb 2022
Learn how Serverless Cloud helps you create fully functional prototypes in no time, all without needing to configure complex cloud infrastructures.
22 Feb 2022
This is a recap of our recent webinar for team leads
17 Feb 2022
Learn how SendGrid makes it super easy to send emails from your Serverless Cloud applications
15 Feb 2022
Combining Next.js and Serverless Cloud is a great way to build highly scalable serverless applications that combine the best features of both platforms.
8 Feb 2022
This article explores the basics of authentication and how to implement it in Serverless Cloud.
3 Feb 2022
In part 2 of this series, we'll look at the Serverless Development Kit (SDK) and see how our interfaces are used to make development faster and automatically create infrastructure.
1 Feb 2022
Use Serverless Cloud to build a Slackbot that automatically adds shared songs to a Spotify playlist.
In a previous blog post, we explained how we built an internal pull-based exception monitoring service called Periskop — which is heavily…
28 Jan 2022
Learn how to connect your Serverless Cloud apps to the widely popular MongoDB.
27 Jan 2022
Here's a tutorial on how to get started with Serverless Framework 3 in just a few minutes!
20 Jan 2022
In this post, we'll dive into the internals of Serverless Cloud to show you what is happening under the hood when you develop and deploy your applications.
19 Jan 2022
This article was originally authored by Srinath Ananthakrishnan, an engineer on the Heroku Runtime Networking Team Summary This following story outlines a recent issue we saw with migrating one of our internal systems over to a new EC2 substrate and in the process breaking one of our customer’s use cases. We also outline how we […] The post The Adventures…
17 Jan 2022
Learn how to build a simple image hosting app on Serverless Cloud by using Serverless Storage
13 Jan 2022
Tutorial on how to build a CSV Parser, powered by Serverless Cloud
6 Jan 2022
Imagine yourself as an engineer who just joined SoundCloud. Besides meeting your colleagues and getting your new laptop, badge, and that…
21 Dec 2021
AWS announced Lambda event filtering during re:Invent 2021. This new feature helps reduce the quantity of Lambda's invocation to exactly match your requirements and possibly save on costs. We'll deep dive into a specific example in this article. We're happy to announce that Serverless Framework now supports event filtering for both `stream` and `sqs` event types via the new `filterPatterns`…
15 Dec 2021
Learn how to setup a custom URL shortener for your startup that you can extend later with Serverless Cloud.
30 Nov 2021
With the new "partial batch response", handling errors in SQS batch processing with Lambda can be much more robust. Serverless Framework supports that new feature today. Learn how to use that new feature with a complete example
26 Oct 2021
Watch the replay of our webinar featuring CEO Austen Collins
13 Oct 2021
This article discusses the powerful design choice of Apache Kafka, “an open-source distributed event streaming platform,” and gives a sneak…
17 Sept 2021
This article is the last part in a series of posts aiming to cast some light onto how service architecture has evolved at SoundCloud over…
1 Sept 2021
Agile development methods can bolster company culture and empower teams to move quickly, with a focus on frequently adding value for customers. Whether you are a program manager, game developer, event planner, or architect, within businesses where change is constant, it’s key to have flexibility, and that’s where agile shines. While there are a variety…
20 Aug 2021
This article is part of a series of posts aiming to cast some light onto how service architecture has evolved at SoundCloud over the past…
29 Jul 2021
This article is part of a series of posts aiming to cast some light onto how service architecture has evolved at SoundCloud over the past…
25 May 2021
SoundCloud was founded 13 years ago, and throughout its history, the company and much of its tech stack has changed. We started with a…
11 Mar 2021
Paging Doctor Software In the past, on-call duty was often associated with doctors, but in recent years, it’s become common for software…
27 Dec 2020
Container Image Support for AWS Lambda has now been added. Read up on why you may (or may not) want to use it and how easy it is to use with the framework
23 Dec 2020
In true JavaScript fashion, there was no shortage of releases in the JavaScript ecosystem this year. This includes the Yarn project’s release of Yarn 2 with a compressed cache of JavaScript dependencies, including a Yarn binary to reference, that can be used for a zero-install deployment. Yarn is a package manager that also provides developers […] The post Building a…
11 Dec 2020
This post previously appeared on the Salesforce Architects blog. Event-driven application architectures have proven to be effective for implementing enterprise solutions using loosely coupled services that interact by exchanging asynchronous events. Salesforce enables event-driven architectures (EDAs) with Platform Events and Change Data Capture (CDC) events as well as triggers and Apex callouts, which makes the […] The post Extend Flows…
1 Oct 2020
Incidents are inevitable. Any platform, large or small will have them. While resiliency work will definitely be an important factor in reducing the number of incidents, hoping to remove all of them (and therefore reach 100% uptime) is not an achievable goal. We should, however, learn as much as we can from incidents, so we […] The post How I…
16 Sept 2020
Your app is slow. It does not spark joy. This post will use memory allocation profiling tools to discover performance hotspots, even when they're coming from inside a library. We will use this technique with a real-world application to identify a piece of optimizable code in Active Record that ultimately leads to a patch with […] The post The Life-Changing…
3 Aug 2020
There are always challenges when it comes to debugging applications. Node.js’ asynchronous workflows add an extra layer of complexity to this arduous process. Although there have been some updates made to the V8 engine in order to easily access asynchronous stack traces, most of the time, we just get errors on the main thread of […] The post Let’s Debug…
22 Jul 2020
YAML files dominate configuration in the cloud-native ecosystem. They’re used by Kubernetes, Helm, Tekton, and many other projects to define custom configurations and workflows. But YAML has its oddities, which is why the Cloud Native Buildpacks project chose TOML as its primary configuration format. What is TOML? TOML stands for Tom’s Obvious, Minimal Language. It’s […] The post Ground Control…
17 Jul 2020
DeveloperBridge: SoundCloud’s Program for Training People from Diverse Backgrounds to Become Engineers
SoundcloudDeveloperBridge is a year-long, full-time, paid traineeship program where participants learn from and work with engineering teams at…
16 Jul 2020
I work on Heroku’s Runtime Infrastructure team, which focuses on most of the underlying compute and containerization here at Heroku. Over the years, we’ve tuned our infrastructure in a number of ways to improve performance of customer dynos and harden security. We recently received a support ticket from a customer inquiring about poor performance in […] The post Making Time…
8 Jul 2020
When API requests are made one-after-the-other they’ll quickly hit rate limits and when that happens: If you provide an API client that doesn’t include rate limiting, you don’t really have an API client. You’ve got an exception generator with a remote timer. — Richard Schneeman Stay Inside (@schneems) June 12, 2019 That tweet spawned a […] The post How We…
6 Jul 2020
If all you want to do is play around and try stuff without worrying bills and costs, serverless is the place for you!
30 Jun 2020
Please also see Part 1: Rethinking the Backend Engineering Interview Take-Home Challenge and Part 2: The Recruiting Perspective and Results…
26 Jun 2020
Please also see Part 1: Rethinking the Backend Engineering Interview Take-Home Challenge Among the engineering groups at SoundCloud, backend…
25 Jun 2020
Technical Interview Reform, Part 1: Rethinking the Backend Engineering Interview Take-Home Challenge
SoundcloudMost SoundCloud backend engineers have good feelings about the old backend engineering take-home challenge. It’s commonly been characterized…
24 Jun 2020
Over the last few years, GraphQL has emerged as a very popular API specification that focuses on making data fetching easier for clients, whether the clients are a front-end or a third-party. In a traditional REST-based API approach, the client makes a request, and the server dictates the response: $ curl https://api.heroku.space/users/1 { "id": 1, […] The post Building a…
22 Jun 2020
This blog post is based on From Project to Productionized, a talk given at PyCon 2020 at the height of the COVID-19 pandemic. You can use this post today to learn how to deploy a Python application on Heroku. More specifically, we’ll show you how to deploy Django apps, including setting up your Django configuration, building […] The post From…
12 Jun 2020
A previous post on this blog ended with the following paragraph: “We might also replace JSON with a more efficient serialization protocol…
30 Apr 2020
This blog post is adapted from a discussion during an episode of our podcast, Code[ish]. Over the last twenty years, software development has advanced so rapidly that it’s possible to create amazing user experiences, powerful machine learning algorithms, and memory efficient applications with incredible ease. But as the capabilities tech provides has changed, so too […] The post Evolving Alongside…
22 Apr 2020
Text-based communication has a long history weaved into the evolution of the Internet, from IRC and XMPP to Slack and Discord. And where there have been humans, there have also been chatbots: scriptable programs that respond to a user’s commands, like messages in a chat room. Chatbots don’t require much in terms of computational power […] The post Building and…
31 Mar 2020
You can now automatically monitor and troubleshoot monolambdas like Express.js and Flask with the Serverless Framework Pro!
16 Mar 2020
Periskop is an exception monitoring service that we built here at SoundCloud. It was designed with microservice environments in mind, but it…
13 Mar 2020
There's a lot to learn about the new AWS HTTP APIs and the Serverless Framework so let's bring it all together in one place.
10 Mar 2020
The Serverless Framework now supports the recently released Lambda Event Destinations.
6 Mar 2020
How do we deploy services all collected under a single monorepo in git?
4 Mar 2020
In the early years of web development, there were three standard fundamentals upon which every website was built: HTML, CSS, and JavaScript. As time passed, web developers became more proficient in their construction of fancy UI/UX widgets for websites. With the need for newer ways of crafting a site coming in conflict with the relatively […] The post Building with…
3 Mar 2020
The topic of datasets is not new, and they have been successfully used at SoundCloud for analytics purposes for a long time. In this blog…
27 Feb 2020
Learn how to create an AWS HTTP API and set it up with a Cognito Authorizer.
17 Feb 2020
Being able to manage multiple different stages of deployment within different environments is essential, and Serverless Framework Pro shows you how
11 Feb 2020
Find out what deployment strategies Serverless Framework Pro's CI/CD feature gives us for managing deployments as a team
10 Feb 2020
A closer look at working with Preview Deployments in the Serverless CI/CD solution.
7 Feb 2020
My first six months at SoundCloud as an iOS engineer on the Recommendations team have just finished. In that time, I’ve already contributed…
4 Feb 2020
In this post, we will cover changes coming to Chrome (and other browsers) that affect how third-party cookies are handled—specifically SameSite changes, how to test to see if your site is impacted and how to fix it. ⚓️ What is SameSite and why the big change? ⚓️ Prepare for Chrome 80 updates ⚓️ Step 1: […] The post Chrome’s Changes…
30 Jan 2020
A large portion of an Android app’s build time can consist of Dagger annotation processing, and most developers agree that productivity is…
24 Jan 2020
Find out how we go about debugging and troubleshooting our Serverless APIs with Serverless Framework Pro
Learn how to use the Serverless Framework to deploy your first Knative service on a Kubernetes cluster running in Google Cloud.
20 Jan 2020
At KotlinConf 2019, I talked about the power of types. In essence, I discussed limiting the number of primitives we use in our code in favor…
15 Jan 2020
As part of our Blackhat Europe talk “Reverse Engineering and Exploiting Builds in the Cloud” we publicly released a new tool called Terrier. Announcing Terrier: An open-source tool for identifying and analysing container and image components. In this blog post, I am going to show you how Terrier can help you identify and verify container […] The post Terrier: Open-Source…
19 Dec 2019
This blog post is adapted from a lightning talk by Ben Fritsch at Ruby on Ice 2019. There can be a number of reasons why your application performs poorly, but perhaps none are as challenging as issues stemming from your database. If your database’s response times tend to be high, it can cause a strain […] The post Slow Database…
Update: On closer inspection, the lock type was not on the table, but on a tuple. For more information on this locking mechanism see the internal Postgresql tuple locking documentation. Postgres does not have lock promotion as suggested in the debugging section of this post. I maintain an internal-facing service at Heroku that does metadata […] The post The Curious…
18 Dec 2019
This blog post is adapted from a talk given by Julián Duque at NodeConf EU 2019 titled “Let it crash!.” Before coming to Heroku, I did some consulting work as a Node.js solutions architect. My job was to visit various companies and make sure that they were successful in designing production-ready Node applications. Unfortunately, I […] The post Let It…
10 Dec 2019
how-to-create-a-landing-page-with-serverless-components
3 Dec 2019
If you were trying to use Lambda in a use case that was very latency sensitive, cold starts were probably your greatest concern. AWS has heard the concerns
21 Nov 2019
Tag your Lambdas to track errors and debug serverless applications. If you’re using NodeJS or Python, we’ll help you find even the trickiest serverless application errors faster.
20 Nov 2019
Tag your Lambdas to track errors and debug serverless applications. If you’re using NodeJS or Python, we’ll help you find even the trickiest serverless application errors faster.
8 Nov 2019
Last week’s update to the SoundCloud iOS app includes support for Dark Mode. This took several months of work and collaboration between…
7 Nov 2019
Learn how to migrate your serverless application monitoring to Serverless Framework Pro from IOpipe.
5 Nov 2019
In this post we'll be looking at how to structure a real-world Serverless Framework application.
31 Oct 2019
As an experiment to see how static typing could help improve our team’s Ruby experience, we introduced Sorbet into a greenfield codebase with a team of 4 developers. Our theory was that adding static type checking through Sorbet could help us catch bugs before they go into production, make refactoring easier, and improve the design […] The post Static Typing…
29 Oct 2019
AWS Lambda Performance Optimization & Monitoring with Tracing & Spans (Serverless Framework Pro)
ServerlessTo troubleshoot the performance of an AWS Lambda function, we need the transaction time of each dependency. Come see how we do that with Serverless Framework Pro
23 Oct 2019
In this article we walk you through how to create a cron job on AWS using AWS Lambda and Serverless Framework and how to get the right alerts and security measures in place.
22 Oct 2019
Over the past four years, the Heroku Runtime team has transitioned from occasional, manual deployments to continuous, automated deployments. Changes are now rolled out globally within a few hours of merging any change—without any human intervention. It's been an overwhelmingly positive experience for us. This post describes why we decided to make the change, how […] The post Automated Continuous…
14 Oct 2019
Learn some of the best practices when it comes to deploying serverless applications.
10 Oct 2019
Learn how to add API Management, Webpack and CI/CD to your Azure Functions REST API
1 Oct 2019
This is part two in a series about solving Gradle remote build cache misses. Solving build cache misses is important to both avoid work that…
17 Sept 2019
Learn how to create, run and deploy a simple REST API to Azure Functions with the Serverless Framework
16 Sept 2019
Using Lambda@Edge is a great way to speed up your application. And the Serverless Framework now has support for it.
11 Sept 2019
We’re happy to announce that you can now deploy Twilio Functions using the Serverless Framework. Here's how!
30 Aug 2019
Until recently, one of the top technical risks facing SoundCloud’s Android team was increasing build times. Our engineering leadership was well aware of the problem, and it was highlighted in our company’s quarterly goals and objectives as modularization. Faster build times means more productive developers. More productive developers are happier and can iterate on products more quickly. Modularization is key…
28 Aug 2019
As outlined in a previous blog post, Heroku Data services undergo routine maintenances for security and patching. In this post, we describe the process used to minimize downtime for Heroku Postgres and Heroku Redis premium ‘High Availability’ plans and how we optimized the process to perform up to 75% faster. Data Services Architecture High availability […] The post Up to…
27 Aug 2019
Learn how to setup monitoring for your existing existing Serverless projects in 2 minutes.
21 Aug 2019
This is the second post in a two-part series about accessibility. The first post shares why designing for accessibility is important to us and why we encourage you to incorporate it into your software design process. Heroku’s first accessibility initiative was to reach Level AA for luminance contrast ratio as defined by the internationally recognized […] The post Designing for…
How to easily deploy a serverless content delivery network (CDN) using Serverless Components.
20 Aug 2019
Learn how to get instant visibility into your AWS Lambda functions with zero instrumentation using Serverless Framework.
15 Aug 2019
Monitoring web APIs in Serverless applications can be difficult. See how to do it with the Serverless Framework.
8 Aug 2019
This post aims to show you how you too can streamline your existing workflow and handle complexity with ease
7 Aug 2019
A practical guide for creating robust, safe and fast serverless components.
5 Aug 2019
Its very likely your organisation has had an S3 bucket or Cognito User Pool in use for a while. Now you can just include them in your Serverless service.
2 Aug 2019
Storing application secrets in serverless applications is a hot topic that provokes many (often contradictory) opinions on how to manage them right.
30 Jul 2019
AWS recently announced the EventBridge offering which helps developers build universal, reliable and fully event-driven applications. Come see how to use it with Serverless Framework
15 Jul 2019
Every organization needs to be data-driven in order to be successful. Whether you’re tracking an application’s performance, incoming support tickets, or revenue rates, different components of any company depend on metrics that inform the health of the business. At Heroku, we’re hackers to the core, but that doesn’t mean we’re all programmers. We build on […] The post Dataclips Power…