37 posts
Pendant plusieurs décennies, l'ingénierie logicielle s'est attachée à optimiser la manière dont les équipes produisaient du code. Demain, elle devra surtout organiser la collaboration entre humains et agents d'intelligence artificielle au sein de véritables systèmes industriels de production.
Riviera is the Dropbox content processing platform that’s been iteratively improving content transformation in our products for roughly a decade.
Un système événementiel qui marche en démo, c'est facile. Un qui tient en prod, c'est une autre histoire. Épisode 4 (et final) de la série EDA : idempotence pour de vrai (avec Redis), observabilité event-driven, alerting sur Mattermost, industrialisation Terraform… et nos vraies galères.
Et si la solution matérielle à votre besoin numérique existait déjà? Pour informatiser un suivi médical, au lieu d’un nouveau service cloud, nous avons détourné l’existant : Mac, Android et enceintes connectées. EROOM, c’est ça : avant de construire, inventoriez. Résultat : une solution frugale, utile, et surtout zéro nouveau matériel acheté.
La présentation traite de la souveraineté numérique sous l'angle de la résilience des organisations. Le message central est que les entreprises ne peuvent plus considérer leur environnement numérique comme stable. Elles doivent désormais gérer leurs dépendances technologiques afin de préserver leur capacité d'action.
Épisode 3 de la série EDA : on suit une candidature de bout en bout, de SmartRecruiters jusqu'à Mattermost, en full AWS. EventBridge, API Gateway, Lambda, SQS, DLQ, CDC… avec du vrai code, des schémas, et même comment brancher un legacy de 13 ans.
Présentation d'un framework de data engineering d'un client d'Octo démontrant des principes intéressants ( and quot;Window-aware pipeline and quot;) pour faciliter leur gestion et leur monitoring
In this post, we show you how to run a one-hour prioritization session with your stakeholders, plot competing initiatives on a shared matrix by cost and impact and turn the result into an actionable architecture backlog - using a framework called Tech Roadmap Prioritization (TRP).
Deuxième volet de notre série EDA : l'article à la fois chiant et utile. On rentre dans la théorie — patterns (Pub/Sub, Event Sourcing, CQRS), garanties de livraison, gestion des ratés (replay, DLQ) et pièges classiques. Promis, on a essayé de rendre ça digeste.
In this post, we show how to build a comprehensive scalable user search layer on top of Amazon Cognito using AWS Lambda, Amazon DynamoDB, and Amazon OpenSearch Service.
On parle souvent de dette technique, de code illisible, de tests manquants. Ces diagnostics sont justes, mais partiels. Ce qui se dégrade en premier dans un système legacy, ce n'est pas le code. C'est la mémoire collective de ceux qui l'ont construit. Et sans elle, même un système propre reste difficile à faire évoluer.
In this post, we show you how to build a hybrid multi-tenant architecture that provides strong tenant isolation without requiring per-tenant AWS accounts. You learn how to configure Route 53 weighted routing to distribute traffic across multiple accounts, deploy Application Load Balancer listener rules for tenant-specific routing, create dedicated ECS clusters per tenant, and establish AWS PrivateLink connectivity to shared…
This post describes a solution that uses fixed camera networks to monitor operational environments in near real-time, detecting potential safety hazards while capturing object floor projections and their relationships to floor markings. While we illustrate the approach through distribution center deployment examples, the underlying architecture applies broadly across industries. We explore the architectural decisions, strategies for scaling to hundreds of…
Crash Course on the Android UI Layer | Part 2 State Holders and Saving State This blog post series aims to summarise the Android Developer guidance on the UI layer . We’ll explore all the entities involved in it, understand the role each part plays, and discuss best practices. By the end of this series, you will have a general…
Crash Course on the Android UI Layer | Part 1 The UI and UI State This blog post series aims to summarise the Android Developer guidance on the UI layer . We’ll explore all the entities involved in it, understand the role each part plays, and discuss best practices. By the end of this series, you will have a general…
This is the story of how we used the Strangler pattern to migrate our public API from a monolithic codebase to a fully fledged BFF over the…
This article discusses the powerful design choice of Apache Kafka, “an open-source distributed event streaming platform,” and gives a sneak…
This article is the last part in a series of posts aiming to cast some light onto how service architecture has evolved at SoundCloud over…
This article is part of a series of posts aiming to cast some light onto how service architecture has evolved at SoundCloud over the past…
This article is part of a series of posts aiming to cast some light onto how service architecture has evolved at SoundCloud over the past…
The topic of datasets is not new, and they have been successfully used at SoundCloud for analytics purposes for a long time. In this blog…
Multi-tenants is an architecture concept that can handle multiple projects in a single project container. If you look at popular sites like Nike.com or Mi.com, you will find out the project redirection based on the continent or country region. This post more about understanding the Angular 8 project package configuration, using this how are we leveraging the project for multi-tenant…
The current SoundCloud iOS App was built back in 2014, resulting in a huge codebase consisting of both Objective-C and Swift, with multiple…
Track play counts are essential for providing a good creator experience on the SoundCloud platform. They not only help creators keep track of their most popular songs, but they also give creators a better understanding of their fanbase and global impact. This post is a continuation of an earlier post that discussed what we do at SoundCloud to ensure creators…
A little less than two years ago, SoundCloud began the journey of replacing our homegrown deployment platform, Bazooka, with Kubernetes. Kubernetes automates deployment, scaling, and management of containerized applications.
Growth in code bases come with exciting scalability challenges. As the size of our iOS codebase and team at SoundCloud grew, we faced challenges: long compile times and conflicts. Our productivity started to suffer as a result. We took inspiration from the work done in the backend (Building Products at SoundCloud) and applied it to mobile development. The main goal…
Once upon a time, we had a single monolith of software, one mothership running everything. At SoundCloud, the proliferation of microservices came from moving functionality out of the mothership. There are plenty of benefits to splitting up features in this way. We want the same benefits for our data as well, by defining ownership of datasets and ensuring that the…
Building and operating services distributed across a network is hard. Failures are inevitable. The way forward is having resiliency as a key part of design decisions. This post talks about two key aspects of resiliency when doing RPC at scale - the circuit breaker pattern, and its power combined with client-side load balancing.
In a previous series of blog posts, we covered our decision to move away from a monolithic architecture, replacing it with microservices, interacting synchronously with each other over HTTP, and asynchronously using events. In this post, we review our progress toward this goal, and talk about the conditions and strategy required to decommission our monolith.
Since we started breaking our monolith and introduced a microservices architecture we rely a lot on synchronous request-response style communication. In this blog post we’ll go over our current status and some of the lessons we learned.
Abstraction layers in software are what architecture astronauts tell you to do. Instead, however, half of all applications out there would be so easy, fun, and most importantly: productive to implement if you just got rid of all those layers. Frankly, what do you really need? You need these two: Some data access Some UI … Continue reading Why You…
In the first two parts of this series, we talked about how SoundCloud started breaking away from a monolithic Ruby on Rails application into…
In the previous post, we talked about how we enabled our teams to build microservices in Scala, Clojure, and JRuby without coupling them…
Most of SoundCloud’s products are written in Scala, Clojure, or JRuby. This wasn’t always the case. Like other start-ups, SoundCloud was…
SoundCloud has a service-oriented architecture, which allows us to use different languages for different services. With concurrency and…
Search is front-and-center in the new SoundCloud, key to the consumer experience. We’ve made the search box one of the first things you see…
This is a story of how we adapted our architecture over time to accomodate growth. Scaling is a luxury problem and surprisingly has more to…
// type to search
