We use a thing called Solr. We brought on a contractor — Andy Smith - to help us scale and improve Solr. Andy is into big data stuff and this, as we learn, qualifies as big data. As I write, there are 7.5 million Pens on CodePen, each with it's own chunk of code, settings, metadata, and whatnot. Those Pens are also indexed for search. That's where Solr comes in. One part of this process is calculating, storing, and most important using popularity scores for Pens, so that we can do smart and useful things with that data.
Show Sponsor: FullStory
Meet FullStory, the pixel-perfect session playback tool that empowers every person in your company to help build the best online experience for your customers. One tiny script captures every click, swipe and scroll on your site – no manual event-tagging required.
What can you do with all this data? Try high-fidelity playback (including the full DOM and console logs, exactly as they ran on your customer’s browser), funnel analytics, detailed search and customer segmentation, plus integrations everyone will want to use from bug-finding tools to support desks.