Meta tags:
author=Shopify Engineering;
description=The Ruby and Rails Infrastructure team at Shopify exists to help ensure that Ruby and Rails are 100-year tools that will continue to merit being our toolchain of choice.;

Headings (most frequently used words):

ruby, in, the, zjit, for, how, yjit, rails, to, memory, and, faster, shopify, of, is, code, as, age, introducing, into, new, sorbet, garbage, collection, on, 2024, we, now, fast, ractor, rubydex, gc, tests, breaking, using, ai, benchmark, modern, at, support, jit, with, open, efficient, lsp, enhancements, first, half, irb, leaks, core, your, monolith, truffleruby, production, guide, linter, structural, checks, projects, inlining, fastpath, bringing, inliner, yielding, benefits, think, about, skips, register, allocator, one, engine, many, tools, hitting, reverted, change, rust, perfetto, removes, redundant, object, loads, stores, engineering, rigor, building, you, can, trust, bundler, available, aliki, theme, documentation, swappable, migration, backend, schema, changes, scale, adding, iongraph, reworking, management, cruby, executes, hidden, mechanics, behind, magic, friendship, ended, rack, bodyproxy, coding, agents, are, removing, programming, language, barriers, source, sabbatical, implementing, embedded, typeddata, objects, it, true, sql, supports, booleans, allocations, has, been, merged, inline, rbs, comments, debugging, tips, recommendations, 2025, interprocedural, sparse, conditional, type, propagation, tiny, jits, ffi, even, more, modular, mmtk, next, generation, out, band, an, introduction, add, system, mastering, navigation, major, mid, year, review, console, finding, ecosystem, fixing, footgun, activerecord, inspect, autotuner, speed, up, app, prism, packwerk, retrospective, catching, assertionless, rubyconf, 2023, unveiling, big, leap, while, less, most, performance, impact, memoization, idiom, effects, pitchfork, reforking, enabling, bootsnap, runs, 15, outperforms, catch, 22, turned, lobste, rs, used, sqlite, db, benchmarking, two, improvements, made, our, storefronts, io, reopen, its, surprising, side, effect, sourcing, builds, making, compatible, ci, rewriting, parser, automatically, find, native, gems, monitoring, load, efficiently, mentor, scaled, maintenance, tasks, adopting, database, adapter, trilogy, software, supply, chain, reading, list, farewell, friend,

Text of the page (most frequently used words):
the (123), ruby (108), and (88), for (39), this (38), that (38), #shopify (36), rails (34), our (32), how (29), yjit (26), 2023 (25), memory (25), with (21), 2025 (21), can (19), zjit (19), are (18), post (18), #performance (17), 2024 (16), new (15), cruby (15), from (14), code (14), 2026 (14), faster (13), now (12), which (12), into (12), you (12), team (11), has (11), some (11), garbage (11), year (10), applications (10), gem (10), jit (10), one (10), its (10), but (10), more (10), feature (10), work (9), core (9), even (9), your (9), have (9), peter (9), most (9), tests (9), objects (9), tools (8), here (8), look (8), about (8), production (8), native (8), zhu (8), truffleruby (8), stan (8), open (7), database (7), also (7), apps (7), while (7), what (7), leaks (7), system (7), collector (7), first (7), typeddata (7), will (6), community (6), migrations (6), take (6), like (6), use (6), gems (6), using (6), level (6), experience (6), improvements (6), been (6), enhancements (6), lsp (6), max (6), bernstein (6), rubydex (6), infrastructure (5), help (5), was (5), part (5), source (5), library (5), why (5), built (5), monolith (5), sorbet (5), app (5), make (5), all (5), run (5), parser (5), language (5), application (5), many (5), development (5), major (5), aaron (5), patterson (5), blog (5), irb (5), packwerk (5), ecosystem (5), add (5), 100 (4), not (4), architecture (4), these (4), want (4), when (4), developers (4), called (4), codebase (4), recently (4), share (4), way (4), implementation (4), based (4), available (4), such (4), years (4), collection (4), time (4), than (4), benchmark (4), used (4), speed (4), object (4), efficient (4), maxime (4), chevalier (4), boisvert (4), prism (4), learn (4), method (4), features (4), half (4), navigation (4), support (4), hartley (4), mcguire (4), embedded (4), scale (4), introducing (4), ensure (3), being (3), engineering (3), friend (3), chris (3), last (3), 2022 (3), important (3), list (3), trilogy (3), quick (3), adopting (3), data (3), simple (3), across (3), let (3), did (3), often (3), catch (3), large (3), complex (3), don (3), think (3), compiler (3), developed (3), requests (3), out (3), date (3), very (3), rewriting (3), kevin (3), they (3), approach (3), fast (3), inlining (3), both (3), taken (3), including (3), next (3), version (3), debugging (3), attributes (3), analysis (3), significantly (3), made (3), sqlite (3), see (3), well (3), default (3), improve (3), other (3), still (3), jean (3), boussier (3), modern (3), better (3), release (3), numbers (3), them (3), bringing (3), cover (3), changes (3), were (3), added (3), tool (3), between (3), inspect (3), sql (3), coding (3), rust (3), does (3), swappable (3), migration (3), backend (3), documentation (3), bundler (3), age (3), allocator (3), linter (3), under (2), exists (2), continue (2), merit (2), toolchain (2), choice (2), away (2), deeply (2), software (2), supply (2), client (2), mysql (2), there (2), 2020 (2), however (2), had (2), adapt (2), millions (2), adrianna (2), chang (2), number (2), off (2), common (2), mistakes (2), andy (2), waite (2), write (2), load (2), understand (2), gannon (2), mcgibbon (2), monitor (2), graphs (2), enabled (2), storefront (2), takashi (2), kokubun (2), fix (2), problem (2), automatically (2), find (2), writing (2), yet (2), yarp (2), every (2), main (2), through (2), behind (2), path (2), forward (2), rubygems (2), org (2), newton (2), future (2), key (2), several (2), allows (2), perform (2), optimize (2), big (2), implement (2), robust (2), workloads (2), developer (2), making (2), definitions (2), testing (2), builds (2), bug (2), fixes (2), short (2), story (2), improving (2), traffic (2), two (2), improved (2), times (2), little (2), benchmarks (2), since (2), lobste (2), benchmarking (2), noah (2), gibbs (2), proud (2), improves (2), turned (2), ability (2), down (2), should (2), optimization (2), breaking (2), once (2), released (2), runs (2), where (2), slower (2), finding (2), working (2), usage (2), reforking (2), pitchfork (2), introduction (2), access (2), cases (2), impact (2), paper (2), programming (2), context (2), jits (2), hard (2), included (2), less (2), along (2), test (2), leap (2), events (2), rubyconf (2), provide (2), great (2), life (2), usable (2), project (2), collaboration (2), designed (2), adaptable (2), running (2), supports (2), parameters (2), works (2), autotuner (2), analyze (2), discuss (2), until (2), terminates (2), significant (2), console (2), seen (2), introduce (2), explain (2), modular (2), runtime (2), management (2), toolkit (2), mmtk (2), stable (2), ffi (2), interprocedural (2), static (2), sparse (2), conditional (2), propagation (2), tips (2), recommendations (2), rbs (2), merged (2), could (2), allocations (2), sabbatical (2), barriers (2), projects (2), agents (2), rack (2), slow (2), iongraph (2), pass (2), layout (2), schema (2), aliki (2), theme (2), eileen (2), alayce (2), edouard (2), chin (2), rigor (2), removes (2), redundant (2), loads (2), stores (2), perfetto (2), sigtrap (2), engine (2), benefits (2), register (2), inliner (2), ractors (2), ractor (2), structural (2), licensed, creative, commons, attribution, noncommercial, sharealike, international, license, subscribe, dear, colleague, seaton, passed, saturday, december, 3rd, notable, figure, saddened, collective, loss, farewell, members, concept, chains, hot, right, attackers, attacking, defenders, defending, bloggers, blogging, academics, academing, chain, reading, jacques, chester, servers, started, adopt, getting, adapter, paarth, madan, solution, performing, fit, sharded, handle, rows, maintenance_tasks, scaled, maintenance, tasks, gotchas, beginners, guard, although, aimed, those, bugs, mentor, usually, frameworks, statements, abstract, concepts, useful, get, loaded, efficiently, newrelic, scout, check, daily, sure, doing, observed, speedups, monitoring, uncommon, encounter, causes, kill, caused, forgot, clean, ruby_memcheck, finds, spent, another, parse, semantically, equivalent, syntax, tree, file, github, popular, downloaded, got, approval, merge, excited, motivations, committed, investments, high, cutting, edge, research, compilers, somewhat, constrained, same, start, quickly, during, warm, makes, challenging, optimizations, function, contrast, authored, predominately, allowing, libraries, provided, trade, needed, extensive, reach, desired, compatibility, extensions, menard, goal, deliver, state, art, rubyists, broader, means, keeping, recent, versions, compatible, emily, samp, sourced, contains, build, api, compliant, vanilla, rubies, additional, backported, sourcing, taught, operations, reopen, surprising, side, effect, arato, constantly, everyone, experiments, largest, highest, found, turn, reduced, response, storefronts, adapted, trying, optimise, rather, separate, postgressql, fact, doesn, disk, unusual, setup, wants, set, optimizes, small, couple, need, real, world, lobsters, nice, adapting, behavior, increase, dropping, reconsider, wisdom, ideal, serious, instead, outperforms, optimized, companies, encourage, enable, places, noticeably, loading, lot, files, really, enabling, bootsnap, randy, stauner, over, regards, extremely, similar, venerable, unicorn, originates, extra, reduce, server, effects, saw, shapes, speedup, instance, variables, pathological, memoization, idiom, gotten, accepted, managed, languages, runtimes, freely, titled, goes, details, strategy, evaluate, findings, comparing, against, existing, jruby, long, shot, evaluating, pragmatic, acm, mplr, say, leaps, bounds, ahead, provides, board, warming, suite, early, delve, introduced, currently, planned, unveiling, continues, investing, moving, participating, dirceu, pereira, tiegs, 300, 000, confidence, duties, intended, ago, article, explore, revised, reveal, ones, nothing, executed, catching, assertionless, nikita, vasilevsky, september, named, enforce, boundaries, modularize, own, inspiring, posts, conference, talks, entire, popularity, indication, clearly, filled, void, retrospective, salzberg, standard, exposed, optionally, represents, person, worth, effort, result, contributors, authors, tooling, scaling, scripts, serve, per, second, may, optimally, case, reason, tune, requires, knowledge, inside, suggestions, tuning, active, record, models, returns, string, model, class, their, values, configure, output, issue, led, talk, fixing, footgun, activerecord, andrew, novoselac, lacked, mechanism, detecting, within, meant, suffered, causing, consume, increasing, amounts, looking, ruby_free_at_exit, leak, checkers, interactive, invaluable, rapid, pace, staying, latest, enhance, workflow, updates, mid, review, particularly, area, thanks, advancement, indexer, dive, touch, experimental, horizon, mastering, solves, showcase, example, ons, vision, addon, enhances, generation, band, describes, override, concrete, alternative, matthew, valentine, house, again, brings, yes, tiny, prototyped, constant, type, together, elevate, inline, comments, alexandre, terrasa, upstream, allocate, allocating, six, read, tip, handwriting, agnostic, queries, true, booleans, implemented, wide, variety, types, enumerator, allocation, decreasing, hood, impacts, implementing, bit, siddarth, challa, dissolving, defined, careers, someone, who, coded, exclusively, decade, contributing, low, couldn, touched, before, removing, best, response_finished, friendship, ended, bodyproxy, compiled, live, switch, bytecode, execution, tracepoint, everything, answers, questions, rarely, explained, executes, hidden, mechanics, magic, sponsors, collaborates, academia, heights, give, overview, australian, national, university, reworking, adds, offers, web, viewer, quality, labeled, backedges, clickable, operands, adding, aiden, fox, ivey, explores, known, lets, customize, relied, monkey, patches, brittle, simply, runner, needs, uses, power, service, gets, fresh, starting, rdoc, dark, mode, search, docs, lang, update, progress, contributed, series, installation, reliably, measure, learned, scaffolding, trusting, gut, something, outsource, building, trust, optimizer, shape, explains, jacob, denbeaux, tracing, visualize, query, pretty, colors, too, starts, giving, surprise, bump, bunch, fail, whose, signal, handler, process, opt, reasons, hitting, reverted, change, alan, portable, powering, tapioca, foundation, compounding, whole, vinicius, stock, landed, lifetimes, interference, linear, scan, global, unlocks, won, skip, skips, helps, specialize, megamorphic, block, invocations, yielding, viable, embrace, unlock, milestone, aiming, framework, inlined, fastpath, specific, rules, understanding, checks, patterns, pitfalls, pull, guide, after, deployment, shenanigans, deployed, regions, sfr, promising, renderer,

Text of the page (random words):
esh look starting with rdoc 7 0 0 aliki is the new default theme bringing dark mode better search and a modern layout to docs ruby lang org and gem documentation 2025 12 08 adrianna chang rails s swappable migration backend for schema changes at scale this post explores rails s swappable migration backend a little known feature that lets applications customize how migrations run at shopify we relied on monkey patches and a brittle sql parser to make rails migrations work with our schema migrations service we developed the swappable backend feature to more simply adapt rails s migration runner to our needs we ll cover why and how we built this and how shopify uses it to power database migrations at scale 2025 11 19 aiden fox ivey adding iongraph support to zjit zjit adds support for iongraph which offers a web based pass by pass viewer with a stable layout better navigation and quality of life features like labeled backedges and clickable operands 2025 09 16 peter zhu reworking memory management in cruby shopify sponsors and collaborates with academia to take ruby to new heights in this post we give an overview of what we ve built in collaboration with the australian national university 2025 09 08 stan lo how ruby executes jit code the hidden mechanics behind the magic where does jit compiled code live how does ruby switch between bytecode and native execution why does tracepoint slow everything down this post answers the jit questions most ruby developers have but rarely see explained 2025 08 26 hartley mcguire friendship ended with rack bodyproxy now rack response_finished is my best friend 2025 07 19 stan lo ai coding agents are removing programming language barriers ai coding tools are dissolving the language barriers that once defined our careers as someone who coded exclusively in ruby for a decade i m now contributing to low level system projects i couldn t have touched before here s how ai coding agents enabled my leap from ruby to c c and rust 2025 07 01 siddarth challa a ruby open source sabbatical in this post i share a bit about the first part of my ruby open source sabbatical experience here at shopify 2025 06 03 peter zhu implementing embedded typeddata objects we implemented a new feature to typeddata objects in ruby called embedded typeddata objects typeddata objects are used across a wide variety of ruby types such as time enumerator and method this feature improves allocation speed and runtime performance while decreasing memory usage in this blog post we ll look at what typeddata objects are under the hood how embedded typeddata objects work and the performance impacts of embedded typeddata objects 2025 05 21 hartley mcguire it s true sql supports booleans a quick tip for handwriting database agnostic sql queries 2025 05 21 aaron patterson fast allocations in ruby 3 5 many ruby applications allocate objects what if we could make allocating objects six times faster we can read on to learn more 2025 05 14 max bernstein zjit has been merged into ruby zjit has been merged into upstream ruby learn about its architecture 2025 04 23 alexandre terrasa inline rbs comments support for sorbet how sorbet and rbs can work together to elevate your ruby development experience 2025 03 14 stan lo ruby debugging tips and recommendations in 2025 a quick list of ruby debugging tips and recommendations from shopify s ruby dx team 2025 02 24 max bernstein maxime chevalier boisvert interprocedural sparse conditional type propagation we prototyped an interprocedural static analysis tool using sparse conditional constant propagation 2025 02 12 aaron patterson tiny jits for a faster ffi can we have a faster ffi for cruby yes 2025 01 10 maxime chevalier boisvert yjit 3 4 even faster and more memory efficient it s 2025 and this year again the yjit team brings you a new version of yjit that is even faster more stable and more memory efficient 2025 01 08 matthew valentine house new for ruby 3 4 modular garbage collection and mmtk this post describes the new modular garbage collection feature in ruby 3 4 the ability to override ruby s gc at runtime we also introduce our first concrete alternative gc implementation based on the memory management toolkit mmtk 2024 10 23 jean boussier next generation out of band garbage collection in this post we look at the impact of a new feature of ruby 3 4 on shopify s monolith 2024 10 03 andy waite an introduction to the ruby lsp add on system in this post we introduce the ruby lsp add on system we ll explain the problem it solves discuss its architecture showcase some example add ons and share our vision for a future addon ecosystem that enhances the ruby development experience 2024 07 18 stan lo mastering ruby code navigation major ruby lsp enhancements in the first half of 2024 in the first half of 2024 ruby lsp has seen significant enhancements particularly in the area of code navigation thanks to the advancement of its indexer in this post we ll dive into the major code navigation enhancements that have been made to ruby lsp we ll also touch on some experimental features that are on the horizon 2024 07 11 stan lo mid year review irb and rails console enhancements in the first half of 2024 as a core part of the ruby ecosystem irb interactive ruby is an invaluable tool for developers with its rapid pace of changes and improvements staying up to date with the latest features can significantly enhance your development workflow in this post we ll cover the significant updates to irb from the first half of 2024 between v1 11 0 and v1 14 0 as well as enhancements in the rails console 2024 07 09 peter zhu finding memory leaks in the ruby ecosystem until recently ruby lacked a mechanism for detecting native level memory leaks from within ruby and native gems this meant that it was hard to analyze ruby applications that suffered from memory leaks causing them to consume increasing amounts of memory until the system runs out and terminates the application in this blog post we ll be looking at the ruby_free_at_exit feature which allows memory leak checkers to find memory leaks in ruby and in native gems 2024 04 30 andrew novoselac fixing a footgun in activerecord core inspect the inspect method on active record models returns a string including the model s class and a list of all its attributes and their values in rails 7 2 you can configure which attributes are included in the output of inspect in this post i ll discuss the performance issue that led me to implement this feature i ll also talk about how this feature can be used to improve developer experience 2024 04 24 peter zhu autotuner how to speed up your rails app ruby s garbage collector is designed to be adaptable scaling from short ruby scripts to running apps that serve millions of requests per second while it s designed to be adaptable it may not work optimally for every use case for this reason ruby s garbage collector supports many parameters that can be used to tune it however the use of these parameters requires knowledge into how the garbage collector works on the inside learn how the autotuner gem can analyze your app s traffic and provide suggestions for tuning the garbage collector 2024 04 16 kevin newton prism in 2024 in ruby 3 3 0 a new standard library was added to cruby called prism prism is a parser for the ruby language exposed as both a c library optionally usable by cruby and a ruby library usable as a ruby gem the prism project represents many person years worth of effort and is the result of a collaboration between shopify cruby core contributors other ruby implementation authors and ruby tooling developers 2024 01 26 gannon mcgibbon chris salzberg a packwerk retrospective in september 2020 our team at shopify released a ruby gem named packwerk a tool to enforce boundaries and modularize rails applications since its release packwerk has taken on a life of its own inspiring blog posts conference talks and even an entire gem ecosystem its popularity is an indication that packwerk clearly filled a void in the rails community 2024 01 25 nikita vasilevsky catching assertionless tests in shopify we have more than 300 000 tests in our core monolith these tests cover most of our application code and provide us with a great level of confidence when making changes to our app but do all tests still perform the duties they were intended to even if some of these tests were added more than 10 years ago in this article we will explore how shopify revised all tests to reveal and fix ones that were testing nothing while still being executed 2024 01 18 dirceu pereira tiegs shopify at rubyconf 2023 shopify continues investing in ruby and rails to help ensure that they are 100 year tools moving them forward and bringing the community with us are a large part of that work and participating in community events like rubyconf is an important part of that 2023 12 19 stan lo unveiling the big leap in ruby 3 3 s irb in this blog post we will delve into the major enhancements introduced in ruby 3 3 s irb as well as what s currently planned for the next year 2023 12 04 maxime chevalier boisvert aaron patterson ruby 3 3 s yjit faster while using less memory this year the yjit team has been working hard to improve and optimize yjit we re proud to say that the version of yjit to be included with ruby 3 3 is leaps and bounds ahead of ruby 3 2 s it provides better performance across the board while also warming up faster and using less memory the 3 3 release is also more robust including a number of bug fixes along with an improved test suite in this blog post we share some early numbers 2023 11 07 maxime chevalier boisvert yjit is the most memory efficient ruby jit this year the yjit team and i have gotten a paper accepted at mplr 2023 managed programming languages and runtimes which is now freely available through acm open access the paper titled evaluating yjit s performance in a production context a pragmatic approach goes into details of the strategy taken to evaluate yjit s performance in a production context one of our key findings when comparing yjit against other existing ruby jits such as jruby and truffleruby is that yjit is the most memory efficient ruby jit by a long shot 2023 10 24 jean boussier performance impact of the memoization idiom on modern ruby ruby 3 2 saw the introduction of object shapes which speedup instance variables access in most cases but can be slower in some pathological cases 2023 10 23 jean boussier effects of pitchfork reforking on shopify s monolith over the last year i ve been working on a new ruby application server called pitchfork in most regards it s extremely similar to the venerable unicorn from which it originates but with one major extra feature reforking which reduce memory usage of ruby applications 2023 10 03 randy stauner enabling bootsnap in truffleruby one of the places where truffleruby is still noticeably slower than cruby is in finding and loading a lot of files do ruby apps really do this 2023 09 18 takashi kokubun ruby 3 3 s yjit runs shopify s production code 15 faster ruby 3 2 yjit has optimized the production workloads of shopify and other companies we encourage you to enable yjit in production once ruby 3 3 is released it should make your application even faster 2023 08 29 aaron patterson ruby outperforms c breaking the catch 22 yjit s ability to improve performance by adapting to run time behavior can increase the speed of our code in a way that dropping down to c can t as such i think we should reconsider the common wisdom that rewriting our ruby in c is the ideal path to performance optimization and take a serious look at rewriting our c in ruby instead 2023 08 25 noah gibbs we turned lobste rs into a rails benchmark for yjit we re very proud of how well yjit the default jit in cruby optimizes rails apps we ve been using small rails benchmarks for a couple of years but as yjit improves we need more data from real world apps to help us understand what will speed up ruby the most we turned the lobsters codebase into a nice new benchmark so how did we do that 2023 08 25 noah gibbs how we used a sqlite memory db for rails benchmarking here at shopify we recently adapted the lobste rs source code into a rails benchmark for yjit but we want very little database time in our benchmarks since we re trying to optimise ruby one way to do that is to use sqlite rather than a separate database like mysql or postgressql in fact faster yet is an in memory sqlite database it doesn t even write to disk but that s an unusual setup and wants some code to set it up want to see how we did it 2023 08 08 peter zhu two garbage collection improvements made our storefronts 8 faster at shopify we are constantly improving the performance of ruby for everyone based on analysis of and experiments on one of our largest and highest traffic apps we found two improvements in ruby s garbage collector that significantly improved our garbage collector performance which in turn reduced our response times by 8 2023 06 19 peter arato io reopen and its surprising side effect a short debugging story that taught us about the attributes of io operations 2023 06 16 peter zhu open sourcing shopify s ruby builds we ve open sourced shopify ruby definitions which contains definitions to build the ruby we use at shopify in development testing and production our builds of ruby are api compliant with the vanilla rubies but with additional bug fixes and performance improvements we ve backported from the next major version 2023 06 16 emily samp making sorbet compatible with ruby 3 2 on the ruby developer experience team here at shopify our goal is to deliver a state of the art development experience to rubyists both at shopify and in the broader community this means keeping our tools up to date with the most recent versions of ruby 2023 06 12 kevin menard truffleruby in shopify ci shopify is deeply committed to the future of ruby one of our key investments is in truffleruby a high performance implementation of the ruby language based on cutting edge compiler research while there are now several jit compilers available for cruby they re somewhat constrained by cruby s architecture the same approach that allows cruby to start up quickly and run fast during warm up also makes it challenging to perform ruby level optimizations such as function inlining in contrast truffleruby is authored predominately in ruby allowing its jit compiler to optimize both application code and the core libraries provided by the language one big trade off of this approach is truffleruby has needed to implement all of cruby s extensive core library in ruby it has taken several years for truffleruby to reach the desired level of compatibility but it s now a robust implementation that can run many complex ruby workloads including rails applications and cruby native extensions 2023 06 12 kevin newton rewriting the ruby parser at shopify we have spent the last year writi...