<?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0" xmlns:itunes="http://www.itunes.com/dtds/podcast-1.0.dtd" xmlns:googleplay="http://www.google.com/schemas/play-podcasts/1.0"><channel><title><![CDATA[Irregular Expressions]]></title><description><![CDATA[All things Irregular]]></description><link>https://substack.irregular.vc</link><image><url>https://substackcdn.com/image/fetch/$s_!ax2Z!,w_256,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fbucketeer-e05bbc84-baa3-437e-9518-adb32be77984.s3.amazonaws.com%2Fpublic%2Fimages%2Febe8505e-0b2a-4807-b5d0-baa5c3c47b54_534x534.png</url><title>Irregular Expressions</title><link>https://substack.irregular.vc</link></image><generator>Substack</generator><lastBuildDate>Tue, 05 May 2026 17:33:57 GMT</lastBuildDate><atom:link href="https://substack.irregular.vc/feed" rel="self" type="application/rss+xml"/><copyright><![CDATA[Irregular Expressions]]></copyright><language><![CDATA[en]]></language><webMaster><![CDATA[irregex@substack.com]]></webMaster><itunes:owner><itunes:email><![CDATA[irregex@substack.com]]></itunes:email><itunes:name><![CDATA[Jean Sini]]></itunes:name></itunes:owner><itunes:author><![CDATA[Jean Sini]]></itunes:author><googleplay:owner><![CDATA[irregex@substack.com]]></googleplay:owner><googleplay:email><![CDATA[irregex@substack.com]]></googleplay:email><googleplay:author><![CDATA[Jean Sini]]></googleplay:author><itunes:block><![CDATA[Yes]]></itunes:block><item><title><![CDATA[A Look into the Most Starred Github Repos]]></title><description><![CDATA[#003: What are common topics and languages? How has ChatGPT changed the OS landscape? Let's find out.]]></description><link>https://substack.irregular.vc/p/a-look-into-the-most-starred-github</link><guid isPermaLink="false">https://substack.irregular.vc/p/a-look-into-the-most-starred-github</guid><dc:creator><![CDATA[Vlad Rachev]]></dc:creator><pubDate>Tue, 24 Sep 2024 15:37:55 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!yVD1!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8a8ac604-85e3-43ab-a0db-49755d2ec182_1384x1184.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p>In our never-ending quest to improve and expand our deal sourcing, I recently started a project to ingest GitHub data and see what we can find there. We already have a number of portfolio companies that began as OS projects, such as <a href="https://www.mermaidchart.com/">Mermaid Chart</a>, creators of <a href="https://github.com/mermaid-js/mermaid">Mermaid.js</a>, and <a href="https://pydantic.dev/">Pydantic</a>, both of which are used by or directly impact millions of people. In total, around 20% of our portfolio companies began as OS projects before becoming actual companies, another 20% started their companies with the main technology built as open-source, and a good chunk of the rest are building at least some part of their product in the open. The prominence of OS in the dev tools / dev infrastructure space is no surprise, and our own investments further support that. It's also why we think there's a lot of sourcing potential in ingesting data from open-source ecosystems, starting with Github, but also Gitlab and others.</p><p>There's lots to be said and argued on the subject of open source - its definition and the various licenses, creator/user relationships, the role of commercial entities in the ecosystem, whether startups should OS their projects and more. I'm not going to delve into that in this post, but for clarification, when I refer to open-source I'm using the layperson definition and including things like open-core and source-available.</p><p>Now the fun stuff! As part of my work on this project, I also cooked up some fun charts and tables around the most popular repos on GitHub, measured simply by star count. All the data and code can be accessed <a href="https://github.com/vrachev/github-repo-analysis">in this project</a>. Feel free to run yourself or create your own charts.</p><h2>Top-line Stats</h2><p>I gathered the list of repos in Github over the past 5 years with more than 100 stars. Naturally, we expect as more time passes more repos will cross that mark, and that's indeed what we get:</p><pre><code><code>Number of repositories in 2019: 34,232
Number of repositories in 2020: 33,191
Number of repositories in 2021: 24,990
Number of repositories in 2022: 19,910
Number of repositories in 2023: 15,416</code></code></pre><p>I also plotted this out to see the growth over time</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!yVD1!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8a8ac604-85e3-43ab-a0db-49755d2ec182_1384x1184.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!yVD1!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8a8ac604-85e3-43ab-a0db-49755d2ec182_1384x1184.png 424w, https://substackcdn.com/image/fetch/$s_!yVD1!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8a8ac604-85e3-43ab-a0db-49755d2ec182_1384x1184.png 848w, https://substackcdn.com/image/fetch/$s_!yVD1!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8a8ac604-85e3-43ab-a0db-49755d2ec182_1384x1184.png 1272w, https://substackcdn.com/image/fetch/$s_!yVD1!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8a8ac604-85e3-43ab-a0db-49755d2ec182_1384x1184.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!yVD1!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8a8ac604-85e3-43ab-a0db-49755d2ec182_1384x1184.png" width="1384" height="1184" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/8a8ac604-85e3-43ab-a0db-49755d2ec182_1384x1184.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1184,&quot;width&quot;:1384,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:215732,&quot;alt&quot;:&quot;&quot;,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" title="" srcset="https://substackcdn.com/image/fetch/$s_!yVD1!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8a8ac604-85e3-43ab-a0db-49755d2ec182_1384x1184.png 424w, https://substackcdn.com/image/fetch/$s_!yVD1!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8a8ac604-85e3-43ab-a0db-49755d2ec182_1384x1184.png 848w, https://substackcdn.com/image/fetch/$s_!yVD1!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8a8ac604-85e3-43ab-a0db-49755d2ec182_1384x1184.png 1272w, https://substackcdn.com/image/fetch/$s_!yVD1!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8a8ac604-85e3-43ab-a0db-49755d2ec182_1384x1184.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>No idea what&#8217;s up with the the yearly peaks in the early months (Feb/March/April). I thought I had duplicate data at first, but that wasn't the case. If anyone has any theories I'd love to hear them. Might just be noise, seeing as it&#8217;s not quite as prevalent in the 5,000 star line.</p><p>Looking at the total over the last 5 years, we have:</p><pre><code><code>Total number of repositories with stars &gt; 100: 127,739
Total number of repositories with stars &gt; 1000: 12,960
Total number of repositories with stars &gt; 5000: 1,982
Total number of repositories with stars &gt; 25000: 184</code></code></pre><p>127k repos with 100 stars in 5 years is pretty crazy to me. Something something "networks". I&#8217;d be curious to get some data of user growth, and growth in user propensity to star projects or engage with Github in a more social way. I also wonder if &#8220;fake&#8221; stars contribute here meaningfully. This is relevant because star count is used as a proxy for popularity/traction/growth, particularly in pitch decks. There&#8217;s a great <a href="https://dagster.io/blog/fake-stars">post from Dagster</a> where they measure &#8220;fake&#8221; stars in projects and dig into the Github star black market.</p><p>For fun, here&#8217;s a table of the most starred repos in the last 5 years:</p><h2>Repo Topics</h2><p>Users can annotate their repos with topics, which gives us some interesting details on prevailing themes/languages/categories.</p><pre><code><code>Unique topics in total: 97,666
Unique topics in 2019: 41,184
Unique topics in 2020: 42,476
Unique topics in 2021: 31,516
Unique topics in 2022: 24,881
Unique topics in 2023: 17,561</code></code></pre><p>We almost have as any unique topics as we do repos, which I think is kind of interesting.</p><p>Of the last 5 years, these are the 25 most popular topics</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!SPX4!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7fd2d820-3f79-4dd0-81d7-1c0b5558fa76_984x590.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!SPX4!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7fd2d820-3f79-4dd0-81d7-1c0b5558fa76_984x590.png 424w, https://substackcdn.com/image/fetch/$s_!SPX4!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7fd2d820-3f79-4dd0-81d7-1c0b5558fa76_984x590.png 848w, https://substackcdn.com/image/fetch/$s_!SPX4!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7fd2d820-3f79-4dd0-81d7-1c0b5558fa76_984x590.png 1272w, https://substackcdn.com/image/fetch/$s_!SPX4!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7fd2d820-3f79-4dd0-81d7-1c0b5558fa76_984x590.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!SPX4!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7fd2d820-3f79-4dd0-81d7-1c0b5558fa76_984x590.png" width="984" height="590" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/7fd2d820-3f79-4dd0-81d7-1c0b5558fa76_984x590.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:590,&quot;width&quot;:984,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:61503,&quot;alt&quot;:&quot;&quot;,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" title="" srcset="https://substackcdn.com/image/fetch/$s_!SPX4!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7fd2d820-3f79-4dd0-81d7-1c0b5558fa76_984x590.png 424w, https://substackcdn.com/image/fetch/$s_!SPX4!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7fd2d820-3f79-4dd0-81d7-1c0b5558fa76_984x590.png 848w, https://substackcdn.com/image/fetch/$s_!SPX4!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7fd2d820-3f79-4dd0-81d7-1c0b5558fa76_984x590.png 1272w, https://substackcdn.com/image/fetch/$s_!SPX4!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7fd2d820-3f79-4dd0-81d7-1c0b5558fa76_984x590.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Here's the same chart but with a 5,000 star cutoff instead of 100</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!eMG7!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc213dbce-6f28-482a-8353-42ac87a11f6b_984x590.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!eMG7!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc213dbce-6f28-482a-8353-42ac87a11f6b_984x590.png 424w, https://substackcdn.com/image/fetch/$s_!eMG7!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc213dbce-6f28-482a-8353-42ac87a11f6b_984x590.png 848w, https://substackcdn.com/image/fetch/$s_!eMG7!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc213dbce-6f28-482a-8353-42ac87a11f6b_984x590.png 1272w, https://substackcdn.com/image/fetch/$s_!eMG7!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc213dbce-6f28-482a-8353-42ac87a11f6b_984x590.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!eMG7!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc213dbce-6f28-482a-8353-42ac87a11f6b_984x590.png" width="984" height="590" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/c213dbce-6f28-482a-8353-42ac87a11f6b_984x590.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:590,&quot;width&quot;:984,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:61639,&quot;alt&quot;:&quot;&quot;,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" title="" srcset="https://substackcdn.com/image/fetch/$s_!eMG7!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc213dbce-6f28-482a-8353-42ac87a11f6b_984x590.png 424w, https://substackcdn.com/image/fetch/$s_!eMG7!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc213dbce-6f28-482a-8353-42ac87a11f6b_984x590.png 848w, https://substackcdn.com/image/fetch/$s_!eMG7!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc213dbce-6f28-482a-8353-42ac87a11f6b_984x590.png 1272w, https://substackcdn.com/image/fetch/$s_!eMG7!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc213dbce-6f28-482a-8353-42ac87a11f6b_984x590.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Anything stand out?</p><ol><li><p>What is going on with &#8220;Hacktoberfest&#8221;?</p><p>It's an annual month-long event that encourages people to contribute to OS. The reason why it's the top-ranking topic for high-star repos is because those projects already have a lot of visibility, and thus attract attention during the event. Note that topics can be added at any time, so a project like <a href="https://github.com/rust-lang/rust">Rust</a> can have the tag, even if it didn&#8217;t start out as a Hacktoberfest project.</p></li><li><p>Python is the OS language king (more about this later).</p></li><li><p>Typescript/Javascript parity, on the surface. But when I looked further, there's a clear trend of Typescript supplanting Javascript. In 2019, Javascript appeared 831 repos to Typescript's 620. In 2023, It was 243 for Javascript vs 364 for Typescript. And of those 243, 89 had also tagged Typescript in the project. The people have spoken!</p></li><li><p>ChatGPT shows up in the 5k star chart, despite only being around for a bit more than a year!</p></li></ol><p>Let&#8217;s take a greater look at the impact of LLMs. The top-N charts for 2019-2022 look more or less the same. Then in late 2022 ChatGPT comes to the scene and completely shifts the attention of the open-source community. Take a look below</p><p><strong>2022</strong></p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!48cR!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F85715481-efbf-4997-b113-3df1cdf179ee_984x590.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!48cR!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F85715481-efbf-4997-b113-3df1cdf179ee_984x590.png 424w, https://substackcdn.com/image/fetch/$s_!48cR!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F85715481-efbf-4997-b113-3df1cdf179ee_984x590.png 848w, https://substackcdn.com/image/fetch/$s_!48cR!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F85715481-efbf-4997-b113-3df1cdf179ee_984x590.png 1272w, https://substackcdn.com/image/fetch/$s_!48cR!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F85715481-efbf-4997-b113-3df1cdf179ee_984x590.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!48cR!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F85715481-efbf-4997-b113-3df1cdf179ee_984x590.png" width="984" height="590" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/85715481-efbf-4997-b113-3df1cdf179ee_984x590.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:590,&quot;width&quot;:984,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:62543,&quot;alt&quot;:&quot;&quot;,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" title="" srcset="https://substackcdn.com/image/fetch/$s_!48cR!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F85715481-efbf-4997-b113-3df1cdf179ee_984x590.png 424w, https://substackcdn.com/image/fetch/$s_!48cR!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F85715481-efbf-4997-b113-3df1cdf179ee_984x590.png 848w, https://substackcdn.com/image/fetch/$s_!48cR!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F85715481-efbf-4997-b113-3df1cdf179ee_984x590.png 1272w, https://substackcdn.com/image/fetch/$s_!48cR!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F85715481-efbf-4997-b113-3df1cdf179ee_984x590.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p><strong>2023</strong></p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!4GZV!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F30ebf278-506b-4aa8-a73a-61aed0eef1bc_984x590.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!4GZV!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F30ebf278-506b-4aa8-a73a-61aed0eef1bc_984x590.png 424w, https://substackcdn.com/image/fetch/$s_!4GZV!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F30ebf278-506b-4aa8-a73a-61aed0eef1bc_984x590.png 848w, https://substackcdn.com/image/fetch/$s_!4GZV!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F30ebf278-506b-4aa8-a73a-61aed0eef1bc_984x590.png 1272w, https://substackcdn.com/image/fetch/$s_!4GZV!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F30ebf278-506b-4aa8-a73a-61aed0eef1bc_984x590.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!4GZV!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F30ebf278-506b-4aa8-a73a-61aed0eef1bc_984x590.png" width="984" height="590" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/30ebf278-506b-4aa8-a73a-61aed0eef1bc_984x590.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:590,&quot;width&quot;:984,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:64599,&quot;alt&quot;:&quot;&quot;,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" title="" srcset="https://substackcdn.com/image/fetch/$s_!4GZV!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F30ebf278-506b-4aa8-a73a-61aed0eef1bc_984x590.png 424w, https://substackcdn.com/image/fetch/$s_!4GZV!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F30ebf278-506b-4aa8-a73a-61aed0eef1bc_984x590.png 848w, https://substackcdn.com/image/fetch/$s_!4GZV!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F30ebf278-506b-4aa8-a73a-61aed0eef1bc_984x590.png 1272w, https://substackcdn.com/image/fetch/$s_!4GZV!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F30ebf278-506b-4aa8-a73a-61aed0eef1bc_984x590.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Craziness. The amount of attention towards LLMs in the Open Source is unlike anything we've seen with any other trend, at least with respect to open source project creation. I wonder how this compares to the early internet days.</p><p>In the full jupyter notebook, I also have some charts around exclusive topics (meaning topics appearing in year X but not year Y). I'm not going to add it here, but one of the topics I saw was "NFT", so I wanted to see how it does in all the years</p><pre><code><code>Number of repositories in 2019 with topic 'nft' and stars &gt;= 100: 5
Number of repositories in 2020 with topic 'nft' and stars &gt;= 100: 7
Number of repositories in 2021 with topic 'nft' and stars &gt;= 100: 75
Number of repositories in 2022 with topic 'nft' and stars &gt;= 100: 35
Number of repositories in 2023 with topic 'nft' and stars &gt;= 100: 0</code></code></pre><p>Yikes! But not surprising.</p><p>It was also fun to look at the counts for AI related terms. Here's one</p><pre><code><code>Number of repositories in 2019 with topic 'llm' and stars &gt;= 100: 10
Number of repositories in 2020 with topic 'llm' and stars &gt;= 100: 8
Number of repositories in 2021 with topic 'llm' and stars &gt;= 100: 15
Number of repositories in 2022 with topic 'llm' and stars &gt;= 100: 52
Number of repositories in 2023 with topic 'llm' and stars &gt;= 100: 663</code></code></pre><p>Note that people can add a topic to a repo whenever, so the pre 2022 repos didn't necessarily have that topic before ChatGPT came out.</p><p>Here's another way to look at the above discrepancy between 2022 and 2023 topics</p><p><strong>Top 25 topics in 2023, by percent of repos with that topic</strong></p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!swEZ!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb1e17fe2-6d64-49b1-af56-2d694ee58473_984x584.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!swEZ!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb1e17fe2-6d64-49b1-af56-2d694ee58473_984x584.png 424w, https://substackcdn.com/image/fetch/$s_!swEZ!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb1e17fe2-6d64-49b1-af56-2d694ee58473_984x584.png 848w, https://substackcdn.com/image/fetch/$s_!swEZ!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb1e17fe2-6d64-49b1-af56-2d694ee58473_984x584.png 1272w, https://substackcdn.com/image/fetch/$s_!swEZ!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb1e17fe2-6d64-49b1-af56-2d694ee58473_984x584.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!swEZ!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb1e17fe2-6d64-49b1-af56-2d694ee58473_984x584.png" width="984" height="584" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/b1e17fe2-6d64-49b1-af56-2d694ee58473_984x584.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:584,&quot;width&quot;:984,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:66666,&quot;alt&quot;:&quot;&quot;,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" title="" srcset="https://substackcdn.com/image/fetch/$s_!swEZ!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb1e17fe2-6d64-49b1-af56-2d694ee58473_984x584.png 424w, https://substackcdn.com/image/fetch/$s_!swEZ!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb1e17fe2-6d64-49b1-af56-2d694ee58473_984x584.png 848w, https://substackcdn.com/image/fetch/$s_!swEZ!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb1e17fe2-6d64-49b1-af56-2d694ee58473_984x584.png 1272w, https://substackcdn.com/image/fetch/$s_!swEZ!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb1e17fe2-6d64-49b1-af56-2d694ee58473_984x584.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>AI topics dominate 2023, Language/Frameworks dominate 2022.</p><p>Last chart on this is around repo activity. In this case, inactive repos are those without a commit in the last 30 days.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!RX4r!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa785d2f9-5ea5-4dcc-a9d2-a671bcf2f3c8_1182x983.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!RX4r!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa785d2f9-5ea5-4dcc-a9d2-a671bcf2f3c8_1182x983.png 424w, https://substackcdn.com/image/fetch/$s_!RX4r!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa785d2f9-5ea5-4dcc-a9d2-a671bcf2f3c8_1182x983.png 848w, https://substackcdn.com/image/fetch/$s_!RX4r!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa785d2f9-5ea5-4dcc-a9d2-a671bcf2f3c8_1182x983.png 1272w, https://substackcdn.com/image/fetch/$s_!RX4r!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa785d2f9-5ea5-4dcc-a9d2-a671bcf2f3c8_1182x983.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!RX4r!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa785d2f9-5ea5-4dcc-a9d2-a671bcf2f3c8_1182x983.png" width="1182" height="983" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/a785d2f9-5ea5-4dcc-a9d2-a671bcf2f3c8_1182x983.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:983,&quot;width&quot;:1182,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:111539,&quot;alt&quot;:&quot;&quot;,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" title="" srcset="https://substackcdn.com/image/fetch/$s_!RX4r!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa785d2f9-5ea5-4dcc-a9d2-a671bcf2f3c8_1182x983.png 424w, https://substackcdn.com/image/fetch/$s_!RX4r!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa785d2f9-5ea5-4dcc-a9d2-a671bcf2f3c8_1182x983.png 848w, https://substackcdn.com/image/fetch/$s_!RX4r!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa785d2f9-5ea5-4dcc-a9d2-a671bcf2f3c8_1182x983.png 1272w, https://substackcdn.com/image/fetch/$s_!RX4r!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa785d2f9-5ea5-4dcc-a9d2-a671bcf2f3c8_1182x983.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Not too much to glean, except that many "ChatGPT" repos are toy apps, but fun to look at. The 10 point differential between GPT4 and GPT3 suggests people have moved onto the newer model.</p><h2>Languages</h2><p>Some repos add languages to &#8220;topics&#8221;, but there&#8217;s a more specific &#8220;language&#8221; field in the repo schema. Github uses <a href="https://github.com/github-linguist/linguist">Linguist</a> to try and determine the &#8220;primary&#8221; language in a repo.</p><p>It more or less confirms what we&#8217;ve seen, primarily the outsized popularity of Python.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!ltsd!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbc74e42b-b3d7-4c27-b7bf-647193554840_984x584.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!ltsd!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbc74e42b-b3d7-4c27-b7bf-647193554840_984x584.png 424w, https://substackcdn.com/image/fetch/$s_!ltsd!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbc74e42b-b3d7-4c27-b7bf-647193554840_984x584.png 848w, https://substackcdn.com/image/fetch/$s_!ltsd!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbc74e42b-b3d7-4c27-b7bf-647193554840_984x584.png 1272w, https://substackcdn.com/image/fetch/$s_!ltsd!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbc74e42b-b3d7-4c27-b7bf-647193554840_984x584.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!ltsd!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbc74e42b-b3d7-4c27-b7bf-647193554840_984x584.png" width="984" height="584" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/bc74e42b-b3d7-4c27-b7bf-647193554840_984x584.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:584,&quot;width&quot;:984,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:50839,&quot;alt&quot;:&quot;&quot;,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" title="" srcset="https://substackcdn.com/image/fetch/$s_!ltsd!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbc74e42b-b3d7-4c27-b7bf-647193554840_984x584.png 424w, https://substackcdn.com/image/fetch/$s_!ltsd!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbc74e42b-b3d7-4c27-b7bf-647193554840_984x584.png 848w, https://substackcdn.com/image/fetch/$s_!ltsd!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbc74e42b-b3d7-4c27-b7bf-647193554840_984x584.png 1272w, https://substackcdn.com/image/fetch/$s_!ltsd!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbc74e42b-b3d7-4c27-b7bf-647193554840_984x584.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>This chart is from all 5 years, but I also looked at each year individually. They mostly looked the same with 2 exceptions - one being that Python <strong>dominated</strong> 2023, going from around 23% of 2019-2022 languages to a whopping 34.5% in 2023. No doubt thanks to its monopoly in data science and AI and the onslaught of such projects in 2023. The other trend was the move from Javascript to Typescript, confirming what I mentioned earlier.</p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://substack.irregular.vc/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://substack.irregular.vc/subscribe?"><span>Subscribe now</span></a></p><div><hr></div><p>X-post from </p><div class="embedded-post-wrap" data-attrs="{&quot;id&quot;:142326956,&quot;url&quot;:&quot;https://vladrachev.substack.com/p/a-look-into-the-most-starred-github&quot;,&quot;publication_id&quot;:2178640,&quot;publication_name&quot;:&quot;Vlad Writes&quot;,&quot;publication_logo_url&quot;:&quot;https://substackcdn.com/image/fetch/f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F96e54907-3ed6-493b-8430-3392a6657cd2_1280x1280.png&quot;,&quot;title&quot;:&quot;A Look into the Most Starred Github Repos&quot;,&quot;truncated_body_text&quot;:&quot;In our never-ending quest to improve and expand our deal sourcing, I recently started a project to ingest GitHub data and see what we can find there. We already have a number of portfolio companies that began as OS projects, such as Mermaid Chart, creators of&quot;,&quot;date&quot;:&quot;2024-03-06T19:56:01.594Z&quot;,&quot;like_count&quot;:1,&quot;comment_count&quot;:0,&quot;bylines&quot;:[{&quot;id&quot;:120975593,&quot;name&quot;:&quot;Vlad Rachev&quot;,&quot;handle&quot;:&quot;vladrachev&quot;,&quot;previous_name&quot;:&quot;Vlad&quot;,&quot;photo_url&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/20d8b38b-0ebc-493d-bf3c-36600d5c84a2_634x610.png&quot;,&quot;bio&quot;:&quot;I invest in early stage (primarily seed) software companies building for developers. Prior to this, I wrote code at MongoDB. \n\n&quot;,&quot;profile_set_up_at&quot;:&quot;2023-01-06T00:07:13.265Z&quot;,&quot;publicationUsers&quot;:[{&quot;id&quot;:2192732,&quot;user_id&quot;:120975593,&quot;publication_id&quot;:2178640,&quot;role&quot;:&quot;admin&quot;,&quot;public&quot;:true,&quot;is_primary&quot;:false,&quot;publication&quot;:{&quot;id&quot;:2178640,&quot;name&quot;:&quot;Vlad Writes&quot;,&quot;subdomain&quot;:&quot;vladrachev&quot;,&quot;custom_domain&quot;:null,&quot;custom_domain_optional&quot;:false,&quot;hero_text&quot;:&quot;New blog, probably writing about tech and investing. Better description to come&quot;,&quot;logo_url&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/96e54907-3ed6-493b-8430-3392a6657cd2_1280x1280.png&quot;,&quot;author_id&quot;:120975593,&quot;theme_var_background_pop&quot;:&quot;#FF6B00&quot;,&quot;created_at&quot;:&quot;2023-12-13T22:59:01.421Z&quot;,&quot;rss_website_url&quot;:null,&quot;email_from_name&quot;:null,&quot;copyright&quot;:&quot;Vlad Rachev&quot;,&quot;founding_plan_name&quot;:null,&quot;community_enabled&quot;:true,&quot;invite_only&quot;:false,&quot;payments_state&quot;:&quot;disabled&quot;,&quot;language&quot;:null,&quot;explicit&quot;:false,&quot;is_personal_mode&quot;:false}},{&quot;id&quot;:3037418,&quot;user_id&quot;:120975593,&quot;publication_id&quot;:493312,&quot;role&quot;:&quot;contributor&quot;,&quot;public&quot;:true,&quot;is_primary&quot;:false,&quot;publication&quot;:{&quot;id&quot;:493312,&quot;name&quot;:&quot;Irregular Expressions&quot;,&quot;subdomain&quot;:&quot;irregex&quot;,&quot;custom_domain&quot;:&quot;substack.irregular.vc&quot;,&quot;custom_domain_optional&quot;:false,&quot;hero_text&quot;:&quot;All things Irregular&quot;,&quot;logo_url&quot;:&quot;https://bucketeer-e05bbc84-baa3-437e-9518-adb32be77984.s3.amazonaws.com/public/images/ebe8505e-0b2a-4807-b5d0-baa5c3c47b54_534x534.png&quot;,&quot;author_id&quot;:311919,&quot;theme_var_background_pop&quot;:&quot;#0068EF&quot;,&quot;created_at&quot;:&quot;2021-09-18T10:02:36.114Z&quot;,&quot;rss_website_url&quot;:null,&quot;email_from_name&quot;:&quot;Irregular Expressions&quot;,&quot;copyright&quot;:&quot;Irregular Expressions&quot;,&quot;founding_plan_name&quot;:null,&quot;community_enabled&quot;:true,&quot;invite_only&quot;:false,&quot;payments_state&quot;:&quot;disabled&quot;,&quot;language&quot;:null,&quot;explicit&quot;:false,&quot;is_personal_mode&quot;:false}}],&quot;twitter_screen_name&quot;:&quot;VladRachev&quot;,&quot;is_guest&quot;:false,&quot;bestseller_tier&quot;:null}],&quot;utm_campaign&quot;:null,&quot;belowTheFold&quot;:true,&quot;type&quot;:&quot;newsletter&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="EmbeddedPostToDOM"><a class="embedded-post" native="true" href="https://vladrachev.substack.com/p/a-look-into-the-most-starred-github?utm_source=substack&amp;utm_campaign=post_embed&amp;utm_medium=web"><div class="embedded-post-header"><img class="embedded-post-publication-logo" src="https://substackcdn.com/image/fetch/$s_!xhHf!,w_56,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F96e54907-3ed6-493b-8430-3392a6657cd2_1280x1280.png" loading="lazy"><span class="embedded-post-publication-name">Vlad Writes</span></div><div class="embedded-post-title-wrapper"><div class="embedded-post-title">A Look into the Most Starred Github Repos</div></div><div class="embedded-post-body">In our never-ending quest to improve and expand our deal sourcing, I recently started a project to ingest GitHub data and see what we can find there. We already have a number of portfolio companies that began as OS projects, such as Mermaid Chart, creators of&#8230;</div><div class="embedded-post-cta-wrapper"><span class="embedded-post-cta">Read more</span></div><div class="embedded-post-meta">2 years ago &#183; 1 like &#183; Vlad Rachev</div></a></div>]]></content:encoded></item><item><title><![CDATA[So You Want to Shift Left?]]></title><description><![CDATA[#002: A look beneath the marketing jargon]]></description><link>https://substack.irregular.vc/p/so-you-want-to-shift-left</link><guid isPermaLink="false">https://substack.irregular.vc/p/so-you-want-to-shift-left</guid><dc:creator><![CDATA[Vlad Rachev]]></dc:creator><pubDate>Tue, 17 Sep 2024 15:34:50 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!je-Q!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F21326aa0-74a3-498c-b081-047c1266fed8_591x394.jpeg" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!je-Q!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F21326aa0-74a3-498c-b081-047c1266fed8_591x394.jpeg" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!je-Q!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F21326aa0-74a3-498c-b081-047c1266fed8_591x394.jpeg 424w, https://substackcdn.com/image/fetch/$s_!je-Q!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F21326aa0-74a3-498c-b081-047c1266fed8_591x394.jpeg 848w, https://substackcdn.com/image/fetch/$s_!je-Q!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F21326aa0-74a3-498c-b081-047c1266fed8_591x394.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!je-Q!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F21326aa0-74a3-498c-b081-047c1266fed8_591x394.jpeg 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!je-Q!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F21326aa0-74a3-498c-b081-047c1266fed8_591x394.jpeg" width="591" height="394" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/21326aa0-74a3-498c-b081-047c1266fed8_591x394.jpeg&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:394,&quot;width&quot;:591,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:36975,&quot;alt&quot;:&quot;A signpost with signs going \&quot;this way\&quot;, \&quot;that way\&quot;, \&quot;other way\&quot;&quot;,&quot;title&quot;:&quot;A signpost with signs going \&quot;this way\&quot;, \&quot;that way\&quot;, \&quot;other way\&quot;&quot;,&quot;type&quot;:&quot;image/jpeg&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="A signpost with signs going &quot;this way&quot;, &quot;that way&quot;, &quot;other way&quot;" title="A signpost with signs going &quot;this way&quot;, &quot;that way&quot;, &quot;other way&quot;" srcset="https://substackcdn.com/image/fetch/$s_!je-Q!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F21326aa0-74a3-498c-b081-047c1266fed8_591x394.jpeg 424w, https://substackcdn.com/image/fetch/$s_!je-Q!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F21326aa0-74a3-498c-b081-047c1266fed8_591x394.jpeg 848w, https://substackcdn.com/image/fetch/$s_!je-Q!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F21326aa0-74a3-498c-b081-047c1266fed8_591x394.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!je-Q!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F21326aa0-74a3-498c-b081-047c1266fed8_591x394.jpeg 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption">Shift-left, shift-right, shift-everywhere??</figcaption></figure></div><p>Shift-left is a popular buzzword in the developer world, with countless pitch decks and marketing copy promising to shift left everything. The movement started gaining popularity with DevOps, the aim being to connect the traditionally disjointed fields of development and operations, and has now grown to include any permutation of business function X and Ops you can think of. DevSecOps, DataOps, MLOps, GitOps, FinOps, ChatOps (<a href="https://www.atlassian.com/blog/software-teams/what-is-chatops-adoption-guide">no seriously</a>). So what is this all about, and is it just marketing hoopla?</p><p>Shift-left is not particularly new. The term has been around since at <a href="https://www.drdobbs.com/shift-left-testing/184404768">least 2001</a>, and the idea itself has been thrown around even earlier. Essentially, it means moving a process (be it testing, managing deployments, monitoring etc..) earlier into the development lifecycle. The advantages make intuitive sense: moving operational processes closer to the development stage results in less friction, better integrations and greater resilience. It&#8217;s also a common sales pitch from infra companies. They&#8217;ll talk about how developers are now empowered to manage X, resulting in faster iteration cycles and cost savings from not needing whoever used to handle X. Sounds great? Maybe.</p><h2>When does shift-left work and when does it fail?</h2><h4>#1 Shift-left done wrong increases cognitive cost for developers and overall complexity</h4><p>For any of you reading this, particularly if you are a software engineer, do you ever feel like you have too many responsibilities? Or that you need to have so many horizontal skills to do the job? If this resonates with you, then you might be paying the cost of shifting left.&nbsp;</p><p>The core idea behind shift-left is to move things that were being done later to being done earlier, but a common pitfall is work being introduced that was never done in the first place! There are a few reasons why this keeps happening.</p><ul><li><p>Team norms and rules around software are rigid and apply to all projects, regardless of size, scope and requirements. Once a practice is shifted left and adopted for one codebase, it often becomes a requirement for all codebases.</p></li><li><p>Engineers like to optimize for maximum robustness and try to <a href="https://xkcd.com/1319/">automate</a> everything. They&#8217;re also financially incentivized to do so in many orgs. Many teams and engineers are not judged by how they contribute to the bottom line but by how complex the work they do is.&nbsp;</p></li><li><p>Not wanting to buy, only wanting to build.</p></li><li><p>Sometimes the requirements change or you have to enable a use-case that wasn&#8217;t possible before. In these cases, the added complexity might be necessary.</p></li></ul><p>When a new responsibility is shifted left onto an engineer without proper tooling and abstractions, it comes with a big huge productivity hit. Sometimes this is necessary, but we should strive to figure out the ROI and costs associated. It&#8217;s great to want to an app the scales horizontally to handle traffic spikes, supports failovers and is connected to an APM tool for all sorts of usage telemetry, but if your app is used internally by 2 people it&#8217;s probably better to just write a quick jupyter notebook and start getting immediate ROI. Partly this becomes a battle of premature optimization vs potential tech debt. Finding a good balance is important.</p><h4>#2 With the right motivation, shift-left can reduce blockers and enable autonomy</h4><p>Shift-left fails when it&#8217;s motivated by the wrong things: cutting costs (never happens), copying trendy processes, or adding complexity for vanity. At its core, shift-left is just the reorientation of process (you can also shift right, or add process in both directions). The goal is to figure out when a process step would be more successful if pushed left. Usually this is true when the current process is incredibly disjointed/siloed, brittle, and so stretched out that the incentives for success are lost in the confusion. Shifting left well requires a lot of work&#8212;good tooling, internal scaffolding (eg. platform/security teams), and a focus on reducing end-user complexity&#8212;but it can dramatically improve iteration speed, create stronger stakeholder/developer alignment and reduce overall pain. &#8220;Shift-left testing&#8221; is a classic example of this and is now the standard at modern companies. With a robust test suite and a well set up CI/CD pipeline, it may take just a few minutes for a code change to go from PR approval to production. This is much better than having manual QA for every change.</p><h4>#3 Not everything needs to be shifted left</h4><p>Above I mentioned that shifting left is simply the reorientation of process. Well, sometimes process needs to be to the right, or in the center, or be a part of multiple steps (people are calling this shift-everywhere). <a href="https://www.linkedin.com/in/planetlevel/">Jeff Williams</a> has a <a href="https://developersalliance.org/security-testing-beware-shifting-left-shift-smart-instead/?">fantastic post</a> on how to think this through. Though he writes specifically about security processes, the ideas are applicable to other fields. Here&#8217;s an example he mentions that should be shifted right:</p><blockquote><p><em>Authentication and authorization.</em>&nbsp;Testing for these vulnerabilities is challenging. These functions almost certainly use custom code unique to the particular application, requiring manual testing such as pen testing. These vulnerabilities should be tested regularly, perhaps every year. Shift right. Far right.</p></blockquote><p>Don&#8217;t just mindlessly shift left!</p><h4>#4 Opportunities for founders</h4><p>The big theme here is the importance of reducing complexity and empowering people to build faster and better. Shift-left is an approach to try and do this, but the crux is in the tooling that makes this possible. Without CI/CD engines, continuous delivery is not possible. Without the cloud, releasing a new app means racking up a server yourself. Companies that transfer complexity from users to their own product will succeed here. Cloud databases are another example here, and near and dear to my heart (I used to work at MongoDB). Today, when I&#8217;m working on a new side-project I can provision a robust, scalable database in minutes by going to a cloud DB vendor. When I worked at MongoDB and was still an engineer, we managed our own database for the internal apps we maintained. No need for a DBA or physical racks. This is the best kind of shift-left - I get autonomy, iteration speed, and arguably less complexity despite additional responsibilities.</p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://substack.irregular.vc/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://substack.irregular.vc/subscribe?"><span>Subscribe now</span></a></p><div><hr></div><p>X-post from</p><div class="embedded-post-wrap" data-attrs="{&quot;id&quot;:141708969,&quot;url&quot;:&quot;https://vladrachev.substack.com/p/so-you-want-to-shift-left&quot;,&quot;publication_id&quot;:2178640,&quot;publication_name&quot;:&quot;Vlad Writes&quot;,&quot;publication_logo_url&quot;:&quot;https://substackcdn.com/image/fetch/f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F96e54907-3ed6-493b-8430-3392a6657cd2_1280x1280.png&quot;,&quot;title&quot;:&quot;So You Want to Shift Left?&quot;,&quot;truncated_body_text&quot;:&quot;Shift-left is a popular buzzword in the developer world, with countless pitch decks and marketing copy promising to shift left everything. The movement started gaining popularity with DevOps, the aim being to connect the traditionally disjointed fields of development and operations, and has now grown to include&#8230;&quot;,&quot;date&quot;:&quot;2024-02-15T22:06:30.845Z&quot;,&quot;like_count&quot;:1,&quot;comment_count&quot;:0,&quot;bylines&quot;:[{&quot;id&quot;:120975593,&quot;name&quot;:&quot;Vlad Rachev&quot;,&quot;handle&quot;:&quot;vladrachev&quot;,&quot;previous_name&quot;:&quot;Vlad&quot;,&quot;photo_url&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/20d8b38b-0ebc-493d-bf3c-36600d5c84a2_634x610.png&quot;,&quot;bio&quot;:&quot;I invest in early stage (primarily seed) software companies building for developers. Prior to this, I wrote code at MongoDB. \n\n&quot;,&quot;profile_set_up_at&quot;:&quot;2023-01-06T00:07:13.265Z&quot;,&quot;publicationUsers&quot;:[{&quot;id&quot;:2192732,&quot;user_id&quot;:120975593,&quot;publication_id&quot;:2178640,&quot;role&quot;:&quot;admin&quot;,&quot;public&quot;:true,&quot;is_primary&quot;:false,&quot;publication&quot;:{&quot;id&quot;:2178640,&quot;name&quot;:&quot;Vlad Writes&quot;,&quot;subdomain&quot;:&quot;vladrachev&quot;,&quot;custom_domain&quot;:null,&quot;custom_domain_optional&quot;:false,&quot;hero_text&quot;:&quot;New blog, probably writing about tech and investing. Better description to come&quot;,&quot;logo_url&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/96e54907-3ed6-493b-8430-3392a6657cd2_1280x1280.png&quot;,&quot;author_id&quot;:120975593,&quot;theme_var_background_pop&quot;:&quot;#FF6B00&quot;,&quot;created_at&quot;:&quot;2023-12-13T22:59:01.421Z&quot;,&quot;rss_website_url&quot;:null,&quot;email_from_name&quot;:null,&quot;copyright&quot;:&quot;Vlad Rachev&quot;,&quot;founding_plan_name&quot;:null,&quot;community_enabled&quot;:true,&quot;invite_only&quot;:false,&quot;payments_state&quot;:&quot;disabled&quot;,&quot;language&quot;:null,&quot;explicit&quot;:false,&quot;is_personal_mode&quot;:false}},{&quot;id&quot;:3037418,&quot;user_id&quot;:120975593,&quot;publication_id&quot;:493312,&quot;role&quot;:&quot;contributor&quot;,&quot;public&quot;:true,&quot;is_primary&quot;:false,&quot;publication&quot;:{&quot;id&quot;:493312,&quot;name&quot;:&quot;Irregular Expressions&quot;,&quot;subdomain&quot;:&quot;irregex&quot;,&quot;custom_domain&quot;:&quot;substack.irregular.vc&quot;,&quot;custom_domain_optional&quot;:false,&quot;hero_text&quot;:&quot;All things Irregular&quot;,&quot;logo_url&quot;:&quot;https://bucketeer-e05bbc84-baa3-437e-9518-adb32be77984.s3.amazonaws.com/public/images/ebe8505e-0b2a-4807-b5d0-baa5c3c47b54_534x534.png&quot;,&quot;author_id&quot;:311919,&quot;theme_var_background_pop&quot;:&quot;#0068EF&quot;,&quot;created_at&quot;:&quot;2021-09-18T10:02:36.114Z&quot;,&quot;rss_website_url&quot;:null,&quot;email_from_name&quot;:&quot;Irregular Expressions&quot;,&quot;copyright&quot;:&quot;Irregular Expressions&quot;,&quot;founding_plan_name&quot;:null,&quot;community_enabled&quot;:true,&quot;invite_only&quot;:false,&quot;payments_state&quot;:&quot;disabled&quot;,&quot;language&quot;:null,&quot;explicit&quot;:false,&quot;is_personal_mode&quot;:false}}],&quot;twitter_screen_name&quot;:&quot;VladRachev&quot;,&quot;is_guest&quot;:false,&quot;bestseller_tier&quot;:null}],&quot;utm_campaign&quot;:null,&quot;belowTheFold&quot;:true,&quot;type&quot;:&quot;newsletter&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="EmbeddedPostToDOM"><a class="embedded-post" native="true" href="https://vladrachev.substack.com/p/so-you-want-to-shift-left?utm_source=substack&amp;utm_campaign=post_embed&amp;utm_medium=web"><div class="embedded-post-header"><img class="embedded-post-publication-logo" src="https://substackcdn.com/image/fetch/$s_!xhHf!,w_56,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F96e54907-3ed6-493b-8430-3392a6657cd2_1280x1280.png" loading="lazy"><span class="embedded-post-publication-name">Vlad Writes</span></div><div class="embedded-post-title-wrapper"><div class="embedded-post-title">So You Want to Shift Left?</div></div><div class="embedded-post-body">Shift-left is a popular buzzword in the developer world, with countless pitch decks and marketing copy promising to shift left everything. The movement started gaining popularity with DevOps, the aim being to connect the traditionally disjointed fields of development and operations, and has now grown to include&#8230;</div><div class="embedded-post-cta-wrapper"><span class="embedded-post-cta">Read more</span></div><div class="embedded-post-meta">2 years ago &#183; 1 like &#183; Vlad Rachev</div></a></div><p></p>]]></content:encoded></item><item><title><![CDATA[Trends in Developer Infrastructure and Tooling - 2024 and Beyond]]></title><description><![CDATA[#001: UX is table stakes, cost matters again, and light at the end of the data stack tunnel?]]></description><link>https://substack.irregular.vc/p/trends-in-developer-infrastructure</link><guid isPermaLink="false">https://substack.irregular.vc/p/trends-in-developer-infrastructure</guid><dc:creator><![CDATA[Vlad Rachev]]></dc:creator><pubDate>Fri, 13 Sep 2024 15:31:41 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!oR--!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffc8e2663-8aaa-4ff8-bee8-348eef38ec0f_1796x784.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!oR--!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffc8e2663-8aaa-4ff8-bee8-348eef38ec0f_1796x784.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!oR--!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffc8e2663-8aaa-4ff8-bee8-348eef38ec0f_1796x784.png 424w, https://substackcdn.com/image/fetch/$s_!oR--!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffc8e2663-8aaa-4ff8-bee8-348eef38ec0f_1796x784.png 848w, https://substackcdn.com/image/fetch/$s_!oR--!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffc8e2663-8aaa-4ff8-bee8-348eef38ec0f_1796x784.png 1272w, https://substackcdn.com/image/fetch/$s_!oR--!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffc8e2663-8aaa-4ff8-bee8-348eef38ec0f_1796x784.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!oR--!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffc8e2663-8aaa-4ff8-bee8-348eef38ec0f_1796x784.png" width="1456" height="636" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/fc8e2663-8aaa-4ff8-bee8-348eef38ec0f_1796x784.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:636,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:1389043,&quot;alt&quot;:&quot;&quot;,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" title="" srcset="https://substackcdn.com/image/fetch/$s_!oR--!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffc8e2663-8aaa-4ff8-bee8-348eef38ec0f_1796x784.png 424w, https://substackcdn.com/image/fetch/$s_!oR--!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffc8e2663-8aaa-4ff8-bee8-348eef38ec0f_1796x784.png 848w, https://substackcdn.com/image/fetch/$s_!oR--!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffc8e2663-8aaa-4ff8-bee8-348eef38ec0f_1796x784.png 1272w, https://substackcdn.com/image/fetch/$s_!oR--!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffc8e2663-8aaa-4ff8-bee8-348eef38ec0f_1796x784.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Thinking about developer trends is one of my favorite parts of <a href="https://www.irregular.vc/team">my job</a>, and I wanted to share some things I&#8217;ve been thinking about for 2024 and beyond. An interesting, albeit obvious thing I&#8217;ve observed about trends is that they take a long, long time to manifest, especially when it comes to developer infrastructure. It&#8217;s hard to pinpoint when a trend that&#8217;s been bubbling up for years hits a critical peak right before it becomes mainstream, so rather than attempt to predict the trends that will hit that peak in 2024, I&#8217;ll share some ideas that are in various stages in their potential S-curves.</p><h3>User Experience Becomes Table Stakes for Developer Products</h3><p>Some of you might be thinking, &#8220;isn&#8217;t this just DevEx? Haven&#8217;t we had dedicated teams doing this for years&#8221;, and yes, we have had that, and we&#8217;ve <em>needed</em> that, because the user experience of most developer products suck, and the ecosystem has gotten so complex that we need a team to help drive best practices.</p><p>I think the tide is changing, and we&#8217;re now seeing products with actual UX baked into it. Between 2010-2020 companies focused on creating infrastructure that scales - we&#8217;ve more or less done that, and now the focus is shifting to infrastructure that is pleasant to work with and improves developer speed.</p><p>Some areas of focus:</p><p><strong>Fixing the CI/CD problem&nbsp;</strong></p><p>We&#8217;re slowly realizing that CI/CD is being wildly misused and does not reduce developer iteration cycles. CI/CD is good at what it does, which is to make it easier to merge code changes into production, especially on large teams working on complex projects. But we&#8217;ve been abusing CI/CD by using it <em>while</em> working on code changes. It&#8217;s not the dev&#8217;s fault - the problem is that tech stacks have gotten very complex and can no longer be tested locally. So devs just push to GitHub and wait 15 minutes for tests to run. Nice for coffee runs, not so much for productivity.</p><p>We&#8217;re starting to see this change, with solutions that enable developers to bypass CI/CD during active development but get similar feedback in seconds instead of minutes. There&#8217;s a number of approaches here. Local emulation is an interesting one, with a few examples like <a href="https://www.wing.cloud/">Wing Cloud</a>, <a href="https://www.localstack.cloud/">LocalStack</a>, and <a href="https://www.systeminit.com/">System Initiative</a>. We&#8217;re also seeing cloud-connected developer environments. There&#8217;s CDEs - like <a href="https://www.gitpod.io/">GitPod</a> and GitHub codespaces which handle environment set up steps like installing dependencies. There&#8217;s also approaches to connect local environments with cloud resources - one example being <a href="https://getampt.com/">Ampt</a>, which has a REPL-like UX where every code change locally updates the live deployment (unique environment per branch) in real-time.&nbsp;</p><p><strong>Static environments -&gt; Dynamic ephemeral environments</strong></p><p>Traditional environment setups amount to a set of 3 or so environments, named something like &#8220;QA/Staging/Prod&#8221;. Naturally, this presents a host of issues when you have multiple people relying on a single environment for testing. For some reason it&#8217;s taken the industry a long time to either realize this and/or do something about it.</p><p>In the last year or so, we&#8217;ve started seeing a number of startups offering the solution - ephemeral environments. Instead of a static set of environments, users are able to get fresh, on-demand environments with production-matching services and seeded DBs. Qovery (our wonderful portfolio company!) has written about this and has a <a href="https://www.qovery.com/blog/top-10-ephemeral-environments-solutions/">list of competitors</a> in the space.</p><p><strong>Modern terminals</strong></p><p>Terminals have been more or less unchanged in 20 years, and we&#8217;ve grown so accustomed to them that my first reaction to <a href="https://www.warp.dev/">Warp</a> was along the lines of &#8220;You can do that? Just make a new terminal?&#8221;. Mostly this is a compliment to the traditional terminal, which I think is different from most of what I talk about here in that the UX is quite good - but I&#8217;m nonetheless very interested in seeing what happens here. The number of companies in this space and the level of funding (Warp recently raised a <a href="https://www.finsmes.com/2023/06/warp-raises-50m-series-b-funding-round.html">$50M series B</a> - in the midst of a growth investing drought no less) supports the view that UX is not just a nice-to-have.</p><p><strong>AI Tooling</strong></p><p>I mostly ignore AI in this article, partly as a silent protest against the never-ending onslaught of AI content, and partly because it&#8217;s a muddy area with little extractable signal. But perhaps the one trend that has already developed is the use of AI in evolving the developer workflow. First it was <a href="https://github.com/features/copilot">Github Copilot</a> with its fancy auto-complete, then we started getting code editors with native ChatGPT support like <a href="https://cursor.sh/">Cursor</a>, and more recently we&#8217;re seeing PR generating bots like <a href="https://sweep.dev/">Sweep</a> and <a href="https://www.ellipsis.dev/">Ellipses</a>. Partly, this is about increasing developer speed - but it&#8217;s also about finding the right UX in this new age. I suspect this will continue to change over the next few years, and it&#8217;ll be interesting to see where we end up.&nbsp;</p><h3>Cost Reduction Driven Innovation</h3><p>In 2022 and 2023, the post-ZIRP economy forced companies to pay attention to a previously long ignored aspect of the income statement - the bottom line. It seems crazy to think that we collectively ignored the primary goal a business has (generate profit) for more than a decade, but when capital is cheap we collectively rationalize a lot of bizarre behavior in the name of growth.</p><p>The transition from top-line to bottom-line focus has been brutal for the startup world, particularly companies who raised at high valuations in 2020 and 2021, but it has also created a new opportunity for startups to compete on, and we&#8217;re seeing a number of new architectural trends in the developer infrastructure world borne out of this new constraint.</p><p>Most of the architectural changes I see are from teams hypothesizing that the metrics and functionality that customers cared about in the last decade are the wrong ones and that we need to change the tradeoffs we make to align with the post-ZIRP reality.</p><p>Cost optimization is happening everywhere and in many forms, but I&#8217;m more interested in products built from the ground up with cost as a key objective. I&#8217;ll share a few approaches I&#8217;ve seen.</p><p><strong>Leveraging Hardware Improvements in Data Infrastructure</strong></p><p>Earlier I wrote:</p><blockquote><p>Between 2010-2020 companies focused on creating infrastructure that scales - we&#8217;ve more or less done that, and now the focus is shifting to infrastructure that is pleasant to work with and improves developer speed.</p></blockquote><p>I left out the reasons behind why this shift is possible, namely (1) the vast majority of companies are (surprise!) not at Google scale, and (2) hardware has improved so much over the last 10 years that many infrastructure needs can be met without needing massive systems.</p><p>Data in particular is seeing a reinvention towards a simpler and cheaper tech stack. <a href="https://duckdb.org/2022/10/12/modern-data-stack-in-a-box.html">Modern Data Stack in a Box with DuckDB</a> - a fantastic post, is the closest thing to prophesying what this future will look like. Of course, a single node data stack is more of an exercise in possibilities - we may still want extra nodes for reliability and such, but it&#8217;s probably not an exaggeration to say that most data computing needs can be fulfilled in a single node with current hardware (and I don&#8217;t just mean using <a href="https://aws.amazon.com/ec2/instance-types/high-memory/">AWS&#8217;s insane 24TiB memory EC2 instances</a>).&nbsp;</p><p>Tools like <a href="https://www.getdbt.com/">DBT</a>, <a href="https://dlthub.com/">DLT</a> and <a href="https://duckdb.org/">DuckDB</a> (amongst a myriad of competitors) are working to create a vastly simpler future, and thanks to hardware advances like the Apple M chips, previously &#8220;large-scale&#8221; end-to-end pipelines can now run locally. This will have big implications for data professionals, both by making development a lot easier but also unlocking new capabilities (eg. distributed pipelines on the edge/client or pipelines running on Lambda).</p><p><strong>Distributed Systems Built on Top of Blob Storage (S3)</strong></p><p>This has long been the case with data warehouses, data lakes and the such. But we&#8217;re starting to see companies in other areas such as streaming, queuing, observability and monitoring. The founders behind Warpstream have written some great <a href="https://www.warpstream.com/blog/kafka-is-dead-long-live-kafka">content</a> on the rationale behind using S3 and the potential to reduce costs by an order of magnitude.</p><p>The idea behind this is fairly simple. S3 is a persistent, highly fault tolerant, and nigh infinitely horizontally scalable K/V store that is significantly cheaper than disk based stores (in most cases at least - some caveats around file sizing and API costs). The big tradeoff here is the latency cost of S3. With block storage one can achieve sub-10ms latency, with S3 p99 latency is closer to 50x that. Clearly this won&#8217;t work for very latency sensitive systems, but many - perhaps most - systems, have requirements that allow for 500ms latency with no service degradation.</p><p>It makes sense that blob storage was first used with data warehouses, as the use-cases services there are traditionally (1) batch based, (2) historical and (3) analytical instead of operational. Companies want to store <em>all</em> their data, but don&#8217;t know if or when they&#8217;ll need it, and so blob storage was a natural candidate. But now founders are asking whether there are more cases where the use-cases are not quite as latency driven as we thought - and what that unlocks.&nbsp;</p><p>Relatedly, minimizing networking costs (egress/ingress) is another key drive. Optimizing cloud costs in general is in vogue, and cloud networking fees are particularly exorbitant (eg. <a href="https://www.confluent.io/blog/understanding-and-optimizing-your-kafka-costs-part-1-infrastructure/#base-workload">59% of cost</a> for a Kafka deployment).</p><p>We&#8217;re seeing infrastructure companies building with networking costs as an underlying constraint, and so are designing their architecture to try and minimize data movement - eg. using blob storage, shifting processing closer to the edge or client, pre-processing information etc..&nbsp;</p><div><hr></div><p>X-post from </p><div class="embedded-post-wrap" data-attrs="{&quot;id&quot;:140782599,&quot;url&quot;:&quot;https://vladrachev.substack.com/p/trends-in-developer-infrastructure&quot;,&quot;publication_id&quot;:2178640,&quot;publication_name&quot;:&quot;Vlad Writes&quot;,&quot;publication_logo_url&quot;:&quot;https://substackcdn.com/image/fetch/f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F96e54907-3ed6-493b-8430-3392a6657cd2_1280x1280.png&quot;,&quot;title&quot;:&quot;Trends in Developer Infrastructure and Tooling - 2024 and Beyond&quot;,&quot;truncated_body_text&quot;:&quot;Thinking about developer trends is one of my favorite parts of my job, and I wanted to share some things I&#8217;ve been thinking about for 2024 and beyond. An interesting, albeit obvious thing I&#8217;ve observed about trends is that they take a long, long time to manifest, especially when it comes to developer infrastructure. It&#8217;s hard to pinpoint when a trend th&#8230;&quot;,&quot;date&quot;:&quot;2024-01-18T00:43:43.659Z&quot;,&quot;like_count&quot;:3,&quot;comment_count&quot;:0,&quot;bylines&quot;:[{&quot;id&quot;:120975593,&quot;name&quot;:&quot;Vlad Rachev&quot;,&quot;handle&quot;:&quot;vladrachev&quot;,&quot;previous_name&quot;:&quot;Vlad&quot;,&quot;photo_url&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/20d8b38b-0ebc-493d-bf3c-36600d5c84a2_634x610.png&quot;,&quot;bio&quot;:&quot;I invest in early stage (primarily seed) software companies building for developers. Prior to this, I wrote code at MongoDB. \n\n&quot;,&quot;profile_set_up_at&quot;:&quot;2023-01-06T00:07:13.265Z&quot;,&quot;publicationUsers&quot;:[{&quot;id&quot;:2192732,&quot;user_id&quot;:120975593,&quot;publication_id&quot;:2178640,&quot;role&quot;:&quot;admin&quot;,&quot;public&quot;:true,&quot;is_primary&quot;:false,&quot;publication&quot;:{&quot;id&quot;:2178640,&quot;name&quot;:&quot;Vlad Writes&quot;,&quot;subdomain&quot;:&quot;vladrachev&quot;,&quot;custom_domain&quot;:null,&quot;custom_domain_optional&quot;:false,&quot;hero_text&quot;:&quot;New blog, probably writing about tech and investing. Better description to come&quot;,&quot;logo_url&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/96e54907-3ed6-493b-8430-3392a6657cd2_1280x1280.png&quot;,&quot;author_id&quot;:120975593,&quot;theme_var_background_pop&quot;:&quot;#FF6B00&quot;,&quot;created_at&quot;:&quot;2023-12-13T22:59:01.421Z&quot;,&quot;rss_website_url&quot;:null,&quot;email_from_name&quot;:null,&quot;copyright&quot;:&quot;Vlad Rachev&quot;,&quot;founding_plan_name&quot;:null,&quot;community_enabled&quot;:true,&quot;invite_only&quot;:false,&quot;payments_state&quot;:&quot;disabled&quot;,&quot;language&quot;:null,&quot;explicit&quot;:false,&quot;is_personal_mode&quot;:false}},{&quot;id&quot;:3037418,&quot;user_id&quot;:120975593,&quot;publication_id&quot;:493312,&quot;role&quot;:&quot;contributor&quot;,&quot;public&quot;:true,&quot;is_primary&quot;:false,&quot;publication&quot;:{&quot;id&quot;:493312,&quot;name&quot;:&quot;Irregular Expressions&quot;,&quot;subdomain&quot;:&quot;irregex&quot;,&quot;custom_domain&quot;:&quot;substack.irregular.vc&quot;,&quot;custom_domain_optional&quot;:false,&quot;hero_text&quot;:&quot;All things Irregular&quot;,&quot;logo_url&quot;:&quot;https://bucketeer-e05bbc84-baa3-437e-9518-adb32be77984.s3.amazonaws.com/public/images/ebe8505e-0b2a-4807-b5d0-baa5c3c47b54_534x534.png&quot;,&quot;author_id&quot;:311919,&quot;theme_var_background_pop&quot;:&quot;#0068EF&quot;,&quot;created_at&quot;:&quot;2021-09-18T10:02:36.114Z&quot;,&quot;rss_website_url&quot;:null,&quot;email_from_name&quot;:&quot;Irregular Expressions&quot;,&quot;copyright&quot;:&quot;Irregular Expressions&quot;,&quot;founding_plan_name&quot;:null,&quot;community_enabled&quot;:true,&quot;invite_only&quot;:false,&quot;payments_state&quot;:&quot;disabled&quot;,&quot;language&quot;:null,&quot;explicit&quot;:false,&quot;is_personal_mode&quot;:false}}],&quot;twitter_screen_name&quot;:&quot;VladRachev&quot;,&quot;is_guest&quot;:false,&quot;bestseller_tier&quot;:null}],&quot;utm_campaign&quot;:null,&quot;belowTheFold&quot;:true,&quot;type&quot;:&quot;newsletter&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="EmbeddedPostToDOM"><a class="embedded-post" native="true" href="https://vladrachev.substack.com/p/trends-in-developer-infrastructure?utm_source=substack&amp;utm_campaign=post_embed&amp;utm_medium=web"><div class="embedded-post-header"><img class="embedded-post-publication-logo" src="https://substackcdn.com/image/fetch/$s_!xhHf!,w_56,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F96e54907-3ed6-493b-8430-3392a6657cd2_1280x1280.png" loading="lazy"><span class="embedded-post-publication-name">Vlad Writes</span></div><div class="embedded-post-title-wrapper"><div class="embedded-post-title">Trends in Developer Infrastructure and Tooling - 2024 and Beyond</div></div><div class="embedded-post-body">Thinking about developer trends is one of my favorite parts of my job, and I wanted to share some things I&#8217;ve been thinking about for 2024 and beyond. An interesting, albeit obvious thing I&#8217;ve observed about trends is that they take a long, long time to manifest, especially when it comes to developer infrastructure. It&#8217;s hard to pinpoint when a trend th&#8230;</div><div class="embedded-post-cta-wrapper"><span class="embedded-post-cta">Read more</span></div><div class="embedded-post-meta">2 years ago &#183; 3 likes &#183; Vlad Rachev</div></a></div><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://substack.irregular.vc/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://substack.irregular.vc/subscribe?"><span>Subscribe now</span></a></p>]]></content:encoded></item><item><title><![CDATA[Matt Bivons]]></title><description><![CDATA[CEO, Canopy]]></description><link>https://substack.irregular.vc/p/matt-bivons</link><guid isPermaLink="false">https://substack.irregular.vc/p/matt-bivons</guid><dc:creator><![CDATA[Jean Sini]]></dc:creator><pubDate>Tue, 21 Sep 2021 16:37:00 GMT</pubDate><enclosure url="https://bucketeer-e05bbc84-baa3-437e-9518-adb32be77984.s3.amazonaws.com/public/images/39784d2c-7419-4014-aa5d-2844dd631876_400x400.jpeg" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p>A few years ago, <strong><a href="https://canopyservicing.com/">Canopy</a></strong> co-founder and CEO Matt Bivons decided to close out a credit card. He called up the credit card company, asked the representative to give him the balance total, made the payment, and assumed that was the end of it.<br></p><p>Until two months later, when he received an email informing him his credit score had dropped 20 points. He called up the credit card company again to point out he&#8217;d paid the full balance and closed the card. Actually, they informed him, he hadn&#8217;t. He&#8217;d had some interest that carried over from mid-cycle; the interest had accumulated late fees; no, they couldn&#8217;t tell him exactly how much more he owed&#8212;not until the end of the cycle, which wouldn&#8217;t be for another month. And sorry, no, they couldn&#8217;t do anything about his credit score.&nbsp;<br></p><p>Tens of thousands of people have experiences like these every day. Why? Because banks, credit card companies, and other financial institutions don&#8217;t have access to real-time data. &#8220;Think about your own card,&#8221; Bivons says. &#8220;You make a payment. Do you have any idea where that payment was applied? Was it applied to the last item first, the highest interest item? You have no idea. And when you call the bank can't tell you either, because they don&#8217;t know.&#8221;<br></p><p><strong><a href="https://medium.com/canopy-servicing/say-hello-to-canopy-an-api-first-modern-loan-management-system-b8d6664b33d7">A decade of experience in private and public fintech, plus frustrations like these</a></strong>, led Bivons and co-founder Will Hanson to start Canopy, a company that builds servicing infrastructure for fintechs and financial institutions. &#8220;Canopy&#8217;s platform is providing this level of transparency and real-time data to allow people to make better decisions,&#8221; Bivons says. In a landscape where many fintechs are itching to offer more personalized credit and lending products, Bivons knew that better credit servicing was essential.&nbsp;</p><p>Historically, fintechs looking to provide credit and lending products had to go through complex and costly regulatory and development pathways to build a single credit offering. Banking cores, the back-end infrastructure that handles accounts management and statements, could quote up to a million dollars in implementation and fees and a 12- to 18-month development timeline. This put loan management and servicing out of reach for most startups.</p><p>Bivons was determined to change this. He built Canopy to allow developers to launch&#8212;and service&#8212;financial products with minimum effort and maximum flexibility. &#8220;Canopy began as a safer student credit card,&#8221; Bivons explains. &#8220;To build the Canopy card, we needed Know Your Customer (KYC) verification, a decision engine, a bank sponsor, and a loan management and servicing system of record. When we learned how expensive &#8212; and limited &#8212; an LMS would be to license, we decided to build it ourselves.&#8221;</p><blockquote><p>The interest from other fintech founders in Canopy&#8217;s back end was so great that Bivons decided to pivot and offer Canopy&#8217;s modern banking core and servicing automations as a service. He envisioned Canopy&#8217;s API powering a cornucopia of new credit and lending products.<br></p></blockquote><p>The interest from other fintech founders in Canopy&#8217;s back end was so great that Bivons decided to pivot and offer Canopy&#8217;s modern banking core and servicing automations as a service. He envisioned Canopy&#8217;s API powering a cornucopia of new credit and lending products.</p><p>&#8220;Credit and lending products have largely been the same,&#8221; he said. &#8220;With Canopy you can customize more than 20 attributes of a financial product. When you combine that with possible variations on an individual attribute, like APR, and you allow for different policies to be applied at the account level, you unlock an incredible variety of lending and credit types.&#8221;</p><p>Customization, scalability, and simplicity are at the heart of Canopy&#8217;s platform. &#8220;Our developers designed our platform and act as an extension of the product team,&#8221; Bivons says. Their combined decades of experience working for scrappy startups and behemoths like Capital One meant they understood the challenges associated with launching a credit product from scratch and also what it takes to safely migrate very large, complex data sets. &nbsp;&#8220;We want developers and operators of Canopy&#8217;s clients to be able to stand up lending products quickly and to personalize those products and not be constrained by the rules of the system or blocked by data migration issues.&#8221;</p><blockquote><p>Thanks to his experience in fintech, Bivons knew that systems of record in particular are a barrier to successfully launching credit products.<br></p></blockquote><p>Thanks to his experience in fintech, Bivons knew that systems of record in particular are a barrier to successfully launching credit products. In addition to an operations team that deals with customer concerns, &#8220;you also need a system of record that is immutable, meaning that the data is always accurate, that you can calculate all the rules and policies on a lending product in real time and retroactively. And then you need to extract that data in a compliant way for statements, for bank reports, et cetera,&#8221; Bivons says.</p><p>Before the launch of Canopy, fintechs often floundered when it came to developing robust systems of record. &#8220;It was not uncommon for startups to use Google Sheets,&#8221; Bivons said. &#8220;That might be fine if you have one customer who's repaying simply, and they repay on time. But what inevitably happens is that a customer misses a payment or calls in, wants to pay off early, wants to add a second product. Now add a hundred thousand users like that. Google Sheets can&#8217;t handle that level of personalization; even CQL or Mongo DBS can't handle that level of personalization. You need a system like Canopy&#8217;s.&#8221;<br></p><p>Canopy&#8217;s rising star suggests that the fintech landscape is more than ready for loan-servicing API platforms. <strong><a href="https://techcrunch.com/2021/08/09/canopy-raises-15m-series-a/?guccounter=1&amp;guce_referrer=aHR0cHM6Ly93d3cuZ29vZ2xlLmNvbS8&amp;guce_referrer_sig=AQAAACrhN89u1H72efgQxL6hAHXiHpvM-XQWngx5p-dGBok95QyI0bTPOxnUIW1HjSihvu-ZWWu3AZ44rYfpZv8tAvlO--0pYRfuVvkQBw3ioiBhubzJ2niMsxrboHotNt4ngM_1aLTOYAmPCss3QXxK6MvsbWcDj1toCtytOVvGI6xx">TechCrunch reported in August 2021</a></strong> that the company&#8217;s customer base grew nearly five times from February to May of 2021, and in <strong><a href="https://goodwordnews.com/canopy-raises-15-million-series-a-after-growing-4-5x-customer-base-in-h1-2021-techcrunch/">August the company announced</a></strong> it closed a $15 million series A funding round (for comparison, Canopy raised $3.5 million in its initial 2020 funding round).&nbsp;</p><blockquote><p>One driver of Canopy&#8217;s growth is the market&#8217;s appetite for more flexible credit and lending products. Last year, 91% of all consumer loans in California were BNPL &#8212; an indication of the pent-up demand for alternative financing.<br></p></blockquote><p>One driver of Canopy&#8217;s growth is the market&#8217;s appetite for more flexible credit and lending products. Last year, 91% of all consumer loans in California were BNPL &#8212; an indication of the pent-up demand for alternative financing.</p><p>Does this mean infrastructure providers like Canopy are the future of fintech? Canopy is, after all, part of a larger banking stack that includes card issuing, compliance, and collections as a service. Best of breed players like Canopy will eventually compete with all-in-one providers. But as of right now, the lack of a modern core is holding everyone back. &#8220;It&#8217;s true that Canopy&#8217;s partner ecosystem is made up of best of breed providers like Lithic, Marqeta, Plaid, and Stripe,&#8221; Bivons said. &#8220;But there&#8217;s no reason why we can&#8217;t be the core inside vertically integrated players, as well. In many cases, we can accelerate their go to market. We&#8217;ve had initial conversations with some of the most promising players. At the end of the day, everyone needs a new core. But once they&#8217;ve built that core, all the differentiation will come from the products they build on top of it and how they take them to market. Their core then becomes a source of technical debt. Having Canopy service that debt &#8212; no pun intended &#8212; makes a lot of sense.&#8221;</p><p><strong>About <a href="https://canopyservicing.com/">Canopy</a></strong></p><p>Canopy offers a plug and play system of record for companies to service lending products efficiently and reliably.</p><p>Founded&nbsp;<strong>2019</strong></p><p>Raised <strong>$15m </strong>as of <strong>Sep 2021 </strong>from <strong>Canaan, BoxGroup, Homebrew, Foundation Capital</strong></p>]]></content:encoded></item><item><title><![CDATA[John Lunn]]></title><description><![CDATA[CEO, Gr4vy]]></description><link>https://substack.irregular.vc/p/john-lunn</link><guid isPermaLink="false">https://substack.irregular.vc/p/john-lunn</guid><dc:creator><![CDATA[Jean Sini]]></dc:creator><pubDate>Thu, 15 Jul 2021 16:59:00 GMT</pubDate><enclosure url="https://bucketeer-e05bbc84-baa3-437e-9518-adb32be77984.s3.amazonaws.com/public/images/41390334-51aa-46e2-8e38-35d9992c245f_400x400.jpeg" length="0" type="image/jpeg"/><content:encoded><![CDATA[<h1><strong>Building the Infrastructure for Digital Commerce</strong></h1><h4><em><strong>Covid-19 has altered the digital commerce landscape for good. Fintech pioneers are developing new ways for midsize online retailers to meet exploding consumer demands.</strong></em></h4><p>After spending twenty years working in payment solutions, most recently with PayPal, <strong><a href="https://techcrunch.com/2021/04/29/gr4vy-launches-cloud-payment-orchestration-pulls-in-11-1m-series-a-led-by-nyca-partners/?guccounter=1&amp;guce_referrer=aHR0cHM6Ly93d3cuZ29vZ2xlLmNvbS91cmw_cT1odHRwcyUzQSUyRiUyRnRlY2hjcnVuY2guY29tJTJGMjAyMSUyRjA0JTJGMjklMkZncjR2eS1sYXVuY2hlcy1jbG91ZC1wYXltZW50LW9yY2hlc3RyYXRpb24tcHVsbHMtaW4tMTEtMW0tc2VyaWVzLWEtbGVkLWJ5LW55Y2EtcGFydG5lcnMlMkYmc2E9RCZzb3VyY2U9ZWRpdG9ycyZ1c3Q9MTYyNzkxNzc3NjMzOTAwMCZ1c2c9QU92VmF3MU5ETEFib21Qa0Q4NWduMTQ3QVlSWA&amp;guce_referrer_sig=AQAAAGQfLSxkexV7wLzv3BOK9ggktFr_WQa3lF0CgdsAo-N2DbTtZvqp-22amRQ1q_iqW6rELNQPUa2JtUyNugAAm5VHcrJxxVrL_eRVQYO6ieHx8A8-3d8iGGeJloep02XiyPSLzIgz2Wb3LNhrqwZTV2lOTb8P-9hBU0s16YTAR49W">Gr4vy founder John Lunn</a></strong> was well aware of a growing roadblock to efficiency: The payments team for every retailer he worked with was building essentially the same product from scratch and entirely independent of one another.<br></p><p>Why the redundancy? It&#8217;s usually simple enough for small online retailers to begin with a platform like Stripe or Braintree for cards. But as businesses scale up, a single solution is no longer enough. They need to add other payment gateway options, like PayPal, Square, Google Pay, and Apple Pay. And international customers may have a completely different set of expectations and needs. &#8220;Different parts of the world use very different methods of payment,&#8221; Lunn says. In Germany, for example, shopping online with a credit card is surprisingly uncommon&#8212;consumers are far more likely to use real-time banking. When he was at PayPal, Lunn worked with a merchant trying to move into South America who was quoted $8 million for each new country because of the payment options they&#8217;d need to add. &#8220;That's just crazy,&#8221; he says. &#8220;That's a ridiculous amount of money. And it's not that hard to do this. It takes time, but not that level of time.&#8221;<br></p><blockquote><p>The problem, Lunn explains, is that the bigger their solutions networks grow, the more difficulties&#8212;and expenses&#8212;retailers encounter. &#8220;You're adding more and more pipes into the plumbing that you're building internally, and it gets bigger and fatter and becomes a problem. I think this has slowed down payment innovation over the last few years.&#8221; Potentially adaptive new platforms, Lunn says, &#8220;never get traction because merchants have to work out the true cost in technical debt and engineering.&#8221;<br></p></blockquote><p>The problem, Lunn explains, is that the bigger their solutions networks grow, the more difficulties&#8212;and expenses&#8212;retailers encounter. &#8220;You're adding more and more pipes into the plumbing that you're building internally, and it gets bigger and fatter and becomes a problem. I think this has slowed down payment innovation over the last few years.&#8221; Potentially adaptive new platforms, Lunn says, &#8220;never get traction because merchants have to work out the true cost in technical debt and engineering.&#8221;</p><p>This complexity was a significant issue before Covid-19, but in the wake of the virus, it may be the single biggest minefield retailers must navigate. &#8220;I saw this at Paypal all the time,&#8221; Lunn says. &#8220;Giving customers the choice of how they pay for things is really going to increase your conversion at checkout. And this has been massively accelerated by Covid.&#8221; Before the virus, Lunn points out, &#8220;having some payment types missing, having some holes, that was okay. But suddenly Covid means 100% of your orders are online. So those small holes became massive gaps. A missing payment option could be the difference between whether you're going to survive or not compared to your competitor who is offering that payment type.&#8221; There&#8217;s been a huge shift, Lunn says, in options available to consumers, like installment payments and one-click checkout. &#8220;As a retailer, you can't ignore that anymore. You've got to do it all to be competitive.&#8221;</p><blockquote><p>42% of American consumers won&#8217;t complete a purchase if they can&#8217;t use their preferred payment method, and 50% of them stop a purchase if they find the checkout method too complicated.<br></p></blockquote><p>The numbers confirm everything Lunn says. <strong><a href="https://econsultancy.com/stats-roundup-the-impact-of-covid-19-on-ecommerce/">Nine out of the top ten global online retailers</a></strong> experienced double-digit revenue growth in 2020, and that trend is only increasing for large and small retailers alike. And consumers balk at any hitches in online checkout. A <strong><a href="https://www.ppro.com/news/retailers-risk-losing-customers/">2020 PPRO survey</a></strong> found that 42% of American consumers won&#8217;t complete a purchase if they can&#8217;t use their preferred payment method, and 50% of them stop a purchase if they find the checkout method too complicated. <strong><a href="https://www.netimperative.com/2021/03/19/lack-of-quick-pay-options-at-check-out-is-costing-retailers-conversions/">Although 41% of retailers have adopted Buy Now Pay Later options</a></strong>, such as Klarna, retailers are falling behind in offering the one-click payment system Amazon has conditioned many consumers to expect.<br></p><p>Obviously, online retailers need to offer as many options as possible. Lunn built Gr4vy to address the snowballing gap between customer expectations and retailer capacity. Gr4vy is a cloud-native platform that merges what Lunn collectively describes as &#8220;<strong><a href="https://www.spreedly.com/blog/payment-orchestration-where-consumer-expectations-and-business-outcomes-meet">payment orchestration</a></strong>&#8221; with payment infrastructure.&nbsp;<br></p><p>Payment orchestration is a relatively new approach that allows retailers to process payments from multiple providers through a single API integration. The payment orchestration layer handles all payment logistics, including fraud detection, reconciliation, and validation.&nbsp;<br></p><blockquote><p>Right now, Lunn says, &#8220;Merchants are not aware enough that orchestration is an option. A lot of what we&#8217;re doing, and why we&#8217;re doing things this way, is that the market needs to learn about the orchestration options.&#8221;&nbsp;</p></blockquote><p>Right now, Lunn says, &#8220;Merchants are not aware enough that orchestration is an option. A lot of what we&#8217;re doing, and why we&#8217;re doing things this way, is that the market needs to learn about the orchestration options.&#8221;&nbsp;<br></p><p>Lunn draws a parallel between payment orchestration and fulfillment. &#8220;Companies used to have to have a connection to DHL and UPS and FedEx and so on. And then along came shipping aggregators that made it really easy for you to pick the best way to ship your bottles. And that's what's going on here. Instead of exploring a custom solution for each new expansion,&nbsp; retailers should get a payment orchestration solution.&#8221;<br></p><p>Like many other fintech innovators, Lunn sees client education as a large component of what he does. The type of client he encounters most often, he says, is a product manager &#8220;who has been given a goal to do something either internationally or with a specific payment type and who is very frustrated by the timelines that they're getting back. People who reach out to us directly are literally like, &#8216;Make my life better. I've been told we need to launch in Japan and it's going to take 12 months. Can you make my life easier?&#8217;&#8221;&nbsp;<br></p><p>But Lunn encourages retailers to think bigger. &#8220;At first, a retailer might not want the entire Gr4vy platform to solve an initial problem. But once we've shown we can fix this problem, they realize the power of everything we can do. We&#8217;re selling a powerful solution that is essentially an alternative to growing an entire payments engineering team.&#8221;&nbsp;<br></p><p>Gr4vy&#8217;s approach isn&#8217;t limited to its home in the cloud. It also offers data residency and sovereignty to its clients. Each merchant has their own instance of Gr4vy in the cloud; they don&#8217;t share infrastructure or server loads with other Gr4vy clients. Customers only pay for what they use, so they can scale up or down without penalty.<br></p><p>Covid-19 has changed the way we shop forever. And <strong><a href="https://www.payoneer.com/enterprise/resources/what-happened-to-payments-why-payment-orchestration-providers-are-the-next-step-in-the-evolution-of-the-payment-market/">payment orchestration pioneers</a></strong> are ensuring mid-size companies are able to nimbly respond to the rapidly evolving demands of the digital marketplace frontier.</p><p><strong>About <a href="https://gr4vy.com/">Gr4vy</a></strong></p><p>Gr4vy is a cloud payment orchestration platform that helps businesses manage their payment solutions.</p><p>Founded&nbsp; <strong>2020</strong></p><p>Raised<strong> $12.2m</strong> as of <strong>Jul 2021 </strong>from <strong>GFC, Nyca, Plug and Play, Activant Capital, Firestartr</strong></p>]]></content:encoded></item><item><title><![CDATA[Caleb Avery]]></title><description><![CDATA[CEO, Tilled]]></description><link>https://substack.irregular.vc/p/caleb-avery</link><guid isPermaLink="false">https://substack.irregular.vc/p/caleb-avery</guid><dc:creator><![CDATA[Jean Sini]]></dc:creator><pubDate>Sun, 06 Jun 2021 17:04:00 GMT</pubDate><enclosure url="https://bucketeer-e05bbc84-baa3-437e-9518-adb32be77984.s3.amazonaws.com/public/images/172cc7d6-e5f2-4524-b49c-8cb558be9dbb_400x400.jpeg" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p>Despite the boom in online commerce, finding the right payment processor is a complex process for most software companies. Tilled founder Caleb Avery is redrawing the map for online payment facilitation&#8212;and changing the landscape of fintech in the process.</p><p><strong>&#8205;</strong>Most of us make purchases online without thinking much about the machinery behind each transaction. For consumers, the process is simple: Punch in your credit card number, and you&#8217;re done. But for merchants, there&#8217;s nothing simple about payment. And until now, that&#8217;s been a growing problem.</p><blockquote><p>For consumers, the process is simple: Punch in your credit card number, and you&#8217;re done. But for merchants, there&#8217;s nothing simple about payment. And until now, that&#8217;s been a growing problem.</p></blockquote><p>The payment facilitation model developed as the newly evolving world of online commerce demanded more flexible payment solutions. <strong><a href="https://www.tilled.com/blog/payment-facilitation-options-for-b2b-software-companies/">Historically, few options existed for online payment processing.</a></strong> In order to accept credit card payments, businesses had to sign up for their own merchant account at a bank&#8212;and the approval process took weeks. Or, merchants could spend years (and millions of dollars) building out their own payment infrastructure.&nbsp;</p><p>&#8205;<strong><a href="https://due.com/blog/payment-facilitator-payfac-model/">Payment facilitators</a></strong> offered a way to circumvent that logjam. Under this framework, the PayFac itself partners with a financial institution, allowing it to apply for its own merchant ID. After approval, the facilitator can use its account to sign up sub-merchants and process their transactions. The facilitator also absorbs the administrative services and compliance requirements&#8212;and risk&#8212;for its sub-merchants. Payment facilitation revolutionized e-commerce: All a business had to do was go online and fill out an application with a PayFac platform. Approval took minutes.</p><blockquote><p>Payment facilitation revolutionized e-commerce: All a business had to do was go online and fill out an application with a PayFac platform. Approval took minutes.</p></blockquote><p>PayFac is a relatively recent innovation; although PayPal went public in 2002, two of the most recognizable payment processors, Stripe and Square, were both founded in 2009. Initially, &#8220;becoming a fully registered PayFac was a two year multi-million dollar process,&#8221; Tilled founder Caleb Avery says. &#8220;Most businesses that are customers of big companies like Stripe and Square and Braintree aren&#8217;t familiar with what it actually takes to operate as a fully registered payment facilitator. It&#8217;s really only in the last few years that the concept of actually becoming that payment facilitator has become much more mainstream.&#8221;</p><blockquote><p>It&#8217;s really only in the last few years that the concept of actually becoming that payment facilitator has become much more mainstream.</p></blockquote><p>The past five years in particular has seen a rise in vertical-specific software solutions for a variety of non-payment merchant needs, such as scheduling customer appointments. &#8220;Every single vertical has their own software solution that is offering more than just payment processing,&#8221; Avery says. &#8220;These vertical software companies are coming in and selling a scheduling tool, a payments collection tool, invoicing, employee management, payroll&#8212;all of these additional benefits aside from just payments. The real question has been, &#8216;How do you power integrated payments inside of these vertical-specific software solutions?&#8217; And that question has been fundamental to the fall of these legacy processors, the rise initially of solutions like Stripe, and now the rise of alternatives to Stripe.&#8221;</p><blockquote><p>The real question has been, &#8216;How do you power integrated payments inside of these vertical-specific software solutions?&#8217; And that question has been fundamental to the fall of these legacy processors, the rise initially of solutions like Stripe, and now the rise of alternatives to Stripe.</p></blockquote><p>Platforms like Stripe succeeded because they were able to provide payment options for vertical platforms in a matter of days, and companies were willing to sacrifice profit for convenience. And Stripe has dominated the PayFac market: <strong><a href="https://backlinko.com/stripe-users">The company</a></strong> is currently valued at $95 billion, and Stripe is used by 1.96 million active websites. But some software companies realized they could potentially bring in greater profits from payment processing than their core products, and Stripe is no longer the right choice for them.</p><blockquote><p>The big shift that&#8217;s happened over the last few years has been all of these vertical software solutions realizing how much money they can make by monetizing their payments.</p></blockquote><p>&#8220;The big shift that&#8217;s happened over the last few years has been all of these vertical software solutions realizing how much money they can make by monetizing their payments,&#8221; Avery says. &#8220;<strong><a href="https://pos.toasttab.com/">Toast</a></strong>, in the restaurant POS space, is a perfect example. They make three and a half times more money on payments than they do on their core software offering. Once you understand that economic landscape, you realize that if your competitors are just giving away all the revenue on payments, you can have an incredibly lucrative revenue stream from payment processing. What a lot of these vertical software companies are starting to do is give away the software and then earn revenue on payments. And it&#8217;s allowing them to achieve a pretty incredible scale in the distribution for their products.&#8221;</p><p>PayFac-in-a-Box solutions like<strong><a href="https://www.infinicept.com/"> Infinicept</a></strong>,<strong><a href="https://www.fenex.io/"> </a><a href="https://www.finixpayments.com/">Finix</a></strong>,<strong><a href="https://www.payrix.com/"> Payrix</a></strong>, and<strong><a href="https://www.amaryllispay.com/"> Amaryllis</a></strong> give companies the opportunity to become PayFacs themselves, but still require a significant investment of time and capital. And, unlike PayFac platforms like Stripe, they require companies to build their own compliance teams and handle their own risk and liability&#8212;a significant hurdle even for larger companies, let alone small startups. &#8220;They took that historically two-year multimillion-dollar process and brought it down about a six-month, couple-of-hundred-thousand-dollar process. That brought down the scale that you have to have achieved in order to make the economics of becoming a PayFac viable. But the reality is, it&#8217;s still six months. It still costs a fair amount of money. And you have to build out a team to handle all the underwriting, the fraud monitoring, KYC, PCI compliance. It&#8217;s a big burden to operate as a fully registered PayFac. Even for companies that have achieved the scale where economically it could make sense, the question is, &#8216;Do you want to take on that overhead and that liability to become a PayFac?&#8217;&#8221;</p><p>Avery worked in the credit card processing space before he spent two years developing Tilled to address this gap. Tilled offers <strong><a href="https://wayneakey.medium.com/payfac-as-a-service-13-questions-you-must-have-answers-to-7f9763750f70">PayFac-as a-Service</a></strong> rather than PayFac-in-a-Box, and ease of use is a core value of the product. &#8220;The focus all along the way was on the ease of implementation. Before we ever wrote the first line of code, my goal was for somebody to be able to come and implement Tilled in under a week,&#8221; Avery says. As importantly&#8212;and as radically&#8212;Tilled is based on a revenue share per transaction model rather than a fee structure.</p><blockquote><p>The focus all along the way was on the ease of implementation. Before we ever wrote the first line of code, my goal was for somebody to be able to come and implement Tilled in under a week.</p></blockquote><p>With Tilled, businesses can be up and running in a matter of weeks, profiting off the payments they process each year with no upfront costs or extra overhead.&nbsp; &#8220;From a business model perspective, when you look at the PayFac-in-a-Box landscape&#8212;those guys are offering consulting packages, plus high SaaS fees, typically $10,000 a month. We came at it from a completely different direction, where it&#8217;s all about a very simple interchange plus wholesale buy rates and then a revenue share. We give our partners the full flexibility to design the pricing models for their end customers.&#8221;</p><p>The market took notice: <strong><a href="https://news.crunchbase.com/news/tilled-takes-a-new-approach-to-payfac-as-a-service-banks-11m-series-a/">Tilled has raised a total of $13.15 million in funding since the company&#8217;s founding in 2019</a></strong>. And the PayFac market is vast and growing. <strong><a href="https://www.prnewswire.com/news-releases/payment-facilitator-market-expected-to-reach-15b-in-payments-revenue-by-2025-301044649.html">It generated $2 billion in transaction revenue in 2018, and is expected to climb to $25 billion by 2025.</a></strong> Avery believes the secret to Tilled&#8217;s success is straightforward: &#8220;There's no cost to working with Tilled. It's a very simple revenue share concept. The combination of those two factors has driven the excitement in the market about what we've built.&#8221;</p><p>Few people understand the complex PayFac ecosystem better than Avery, and building a knowledge base is a major priority for the company. &#8220;Education is a huge component of what we&#8217;re doing, and it&#8217;s a big part of our strategy. It&#8217;s less about building up a huge salesforce, and more about getting the word out there through conversation and letting the world know about the paradigm we believe in. We&#8217;ll come in and talk with our partners and our customers and educate them on the landscape and the options that are available to them to help them figure out what the right option is for their business.&#8221;</p><p><strong>About <a href="https://www.tilled.com/">Tilled</a></strong></p><p>Tilled is a PayFac-as-a-Service platform that allows B2B ISVs to monetize payments that pass through their platforms.</p><p><strong>Fintech</strong></p><p>Founded&nbsp; <strong>2019</strong></p><p>Raised <strong>$13.2m </strong>as of <strong>June 2021 </strong>from<strong> Canvas Ventures, Alumni Ventures Group, Peterson Ventures, Clocktower, SaaS Ventures, Abstract Ventures, Hack VC</strong></p>]]></content:encoded></item><item><title><![CDATA[Gatsby]]></title><description><![CDATA[Co-CEO, Gatsby]]></description><link>https://substack.irregular.vc/p/gatsby</link><guid isPermaLink="false">https://substack.irregular.vc/p/gatsby</guid><dc:creator><![CDATA[Jean Sini]]></dc:creator><pubDate>Mon, 10 May 2021 17:09:00 GMT</pubDate><enclosure url="https://bucketeer-e05bbc84-baa3-437e-9518-adb32be77984.s3.amazonaws.com/public/images/1ecba5c8-42d1-465c-8a69-6debabe032e3_400x400.jpeg" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p>Young traders&#8217; enthusiasm for high-risk trading and a radically simplified user experience are radically transforming the market. Driven by highly accessible trading apps and a year spent in lockdown, these shifts ensure the future of fintech is anything but certain.</p><blockquote><p>And apps like Gatsby, Robinhood, and E-Trade are drawing in unprecedented numbers of young investors whose attitude to trading is radically different from previous generations.</p></blockquote><p>Gatsby cofounder Jeff Myers is riding the wave. Gatsby is a social network and a commission-free stocks and options trading platform. Its name a deliberate nod to the famously wealthy character of Jay Gatsby, the app strips away jargon and simplifies the process of trading, allowing users to express trade opinions with more leverage and find inspiration and ideas in their friends&#8217; trades. And apps like Gatsby, Robinhood, and E*Trade are drawing in unprecedented numbers of young investors whose attitude to trading is radically different from previous generations.</p><blockquote><p>This generation really wants to use trading as a form of entertainment.</p></blockquote><p>&#8220;This generation really wants to use trading as a form of entertainment,&#8221; says Myers. When he and co-founder Ryan Belanger-Saleh started developing the app in 2017, they started by talking to their friends. &#8220;Most of them had maybe 90% of their money on a robot adviser or a savings account, just sitting around passively in a more responsible way. With the remaining 10% they were trading cryptocurrencies, sports betting&#8212;whatever alternative form of investing that typically has a lot of volatility and an adrenaline rush.&#8221; Younger people were open to a level of risk, older, more traditional investors were not. &#8220;They have less money and less access to opportunity than previous generations in America. They&#8217;re in the gig economy. There&#8217;s a very entrepreneurial spirit among Gen Z and Millennials,&#8221; Myers points out.</p><blockquote><p>The trend toward younger traders with a high risk affinity was only accelerated by the pandemic.</p></blockquote><p>The trend toward younger traders with a high risk affinity was only accelerated by the pandemic. <strong><a href="https://markets.businessinsider.com/news/stocks/gen-z-millennial-investor-risk-tolerance-stock-market-outlook-meme-2021-6-1030496370">A 2021 E*Trade study showed 58% of investors under 34 are trading more frequently, and 55% said they are trading derivatives more frequently</a></strong>. A survey conducted by the investment management service Nutmeg found that its users aged 25-34 were most bullish about personal finances and investing. <strong><a href="https://www.npr.org/2020/08/11/895054084/millions-turn-to-stock-trading-during-pandemic-but-some-see-trouble-for-the-youn">Robinhood&#8217;s customer base, whose average age is 33, grew by three million users in the first four months of 2020</a></strong>. Some industry experts estimate that Robinhood&#8217;s current user base <strong><a href="https://www.cnbc.com/2021/05/25/robinhoods-disruptive-trade-the-good-the-bad-and-the-controversy.html">is closer to 20 million</a></strong>, a number Robinhood has not confirmed.</p><blockquote><p>Regardless of the numbers, it&#8217;s a fact that apps like Gatsby are designed to appeal to Millennial and Gen Z investors.</p></blockquote><p>Regardless of the numbers, it&#8217;s a fact that apps like Gatsby are designed to appeal to Millennial and Gen Z investors. Young traders, Myers notes, are plugged into multiple information workflows simultaneously, and they don&#8217;t want an interface that interferes with their access to other content streams. &#8220;When we first started Gatsby we designed it for ourselves, but that put us into a position where we were attracting very young traders. We thought, what are cool features that young traders specifically would want?&#8221;</p><p>In addition to its simplicity and accessibility, Gatsby&#8217;s users are drawn to the app&#8217;s social feed, which lets users see and take inspiration from community trends along with other feeds, like Twitter or TikTok. Community members start to recognize prolific users and pursue bullish behavior trends on the same ticker. &#8220;We baked that concept right into the app. Gatsby is a social network. You can see what everybody&#8217;s trading, you can like each other&#8217;s trades, you can comment on your trades. So I think every little differentiator that we have, every feature that we have that another brokerage doesn&#8217;t, or does a little bit differently, is tailored around this specific segment of traders.&#8221;</p><blockquote><p>But critics say apps like Gatsby and Robinhood put young investors at risk by turning trading into a game without making users aware of the consequences.</p></blockquote><p>But critics say apps like Gatsby and Robinhood put young investors at risk by turning trading into a game without making users aware of the consequences. In June of 2020 a <strong><a href="https://www.forbes.com/sites/sergeiklebnikov/2020/06/17/20-year-old-robinhood-customer-dies-by-suicide-after-seeing-a-730000-negative-balance/?sh=2efaae6f1638">20-year-old Robinhood investor died by suicide</a></strong> after mistakenly believing he&#8217;d lost $750,000 on a risky trade. His parents, <strong><a href="https://www.cbsnews.com/news/alex-kearns-robinhood-trader-suicide-wrongful-death-suit/">who are suing the company</a></strong>, say Robinhood deliberately targets young, inexperienced users and pushes them into high-risk trading.</p><blockquote><p>You can't take speculation as a strategy in your portfolio and assume that you're going to make money.</p></blockquote><p>&#8220;You can't take speculation as a strategy in your portfolio and assume that you're going to make money,&#8221; Myers says. &#8220;And we try to be very clear that there's a lot of risk involved in trading options, which are inherently very speculative. But you can use it to hedge other elements of your portfolio, or you can view it as just a fun thing to do with a small portion of the portfolio.&#8221; He also points out the users themselves are subject to encounter unusual market conditions like trade halts. &#8220;We have a push notification on specific tickers that have either SEC- or FINRA-driven warnings&#8212;or even our own warnings&#8212;about certain scenarios in the market. We've done it if something's expected to be extremely volatile and one of the exchanges will halt trading around it. Which also irritates users. And they usually blame the introducing broker, even though it just isn't trading, it's frozen by the exchange.&#8221;</p><p>Like any other investment platform, <strong><a href="https://www.npr.org/2019/10/01/766110889/schwab-cuts-commissions-to-zero-as-free-trading-edges-toward-the-norm">Gatsby operates in a post-commission based brokerage revenue stream</a></strong>. &#8220;We&#8217;re actually big believers in payment for order flow,&#8221; Myers explains. &#8220;The concept is what allows any type of exchange to have a healthy source of liquidity, right? If you&#8217;re trying to make a fine art marketplace, you need art and you need buyers, and you would probably pay to have more buyers on your platform and have more fine art for them to buy. And that&#8217;s sort of what payment for order flow is.&#8221; Myers agrees that payment for order flow got a bad reputation early on, in part because Robinhood in particular denied taking it. Transparency, he says, is extremely important. &#8220;We like to be very upfront with our users on that. It&#8217;s how we drive revenue. In fact, now that commissions are more or less gone, our approach is to add transparency.&#8221;</p><blockquote><p>20% of all retail traders currently holding positions now bought their first position in 2020. Every month, so far, in 2021 has had a higher volume of options contracts traded than any other year in history. 2021 is a monster year for trade volumes driven largely by retail traders.</p></blockquote><p>Gatsby has been able to nimbly capitalize on the rapid shift from passive investment accounts to active trading, but Myers points out that the investment world is changing so rapidly that it&#8217;s impossible to predict how regulators will navigate trends around volatile products like cryptocurrency or meme stocks. &#8220;20% of all retail traders currently holding positions now bought their first position in 2020. Every month, so far, in 2021 has had a higher volume of options contracts traded than any other year in history. 2021 is a monster year for trade volumes driven largely by retail traders. Which shows a correlation in interest out there tied to meme stocks&#8212;you can definitely inversely correlate our cost per acquisition to the price of GameStop as of this year, and Tesla was basically a meme stock the entire last year.&#8221;</p><blockquote><p>But there&#8217;s this brand new concept of trading as entertainment having a crazy impact on stock values. I think that&#8217;s more of a culmination of a trend than a brand new phenomenon, but it&#8217;s fun.</p></blockquote><p>For Myers, the uncertainty is part of the package&#8212;and that&#8217;s a good thing. He prescribes embracing the risk-taking spirit of adventure that characterizes Gatsby&#8217;s users. &#8220;With nobody really to blame, the regulators don&#8217;t know what to do about it, or who&#8217;s responsible, or if the brokers should have prevented it. But there&#8217;s this brand new concept of trading as entertainment having a crazy impact on stock values. I think that&#8217;s more of a culmination of a trend than a brand new phenomenon, but it&#8217;s fun.&#8221;</p><p>About <strong><a href="http://trygatsby.com/">Gatsby</a></strong></p><p>Gatsby is a no-commission stocks and options trading platform that makes investing approachable to everyone.</p><p>Founded&nbsp;<strong>2018</strong></p><p>Raised <strong>$13m </strong>as of May<strong> 2021</strong> from <strong>Techstars, Beta Bridge Capital, Rosecliff Ventures, SWS, Barclays, Plug and Play</strong></p>]]></content:encoded></item></channel></rss>