Experience:
No experience
Employment Type:
Full time
Posted:
6/30/2015
Job Category:
Engineering
Software Engineer - Platform Infrastructure (Data...
(This job is no longer available)
Twitter | San Francisco, CA
loading
loading
School
Major
Grad Date
 
 

Not sure what types of jobs you are interested in?


Explore Jobs
Based on Your Education

Follow This Company
Share

Job Description

TellApart:

Direct response advertising has been a major growth engine for our ads business over the last several quarters. And we're confident that our recent acquisition of TellApart (@tellapart) will accelerate that trajectory further. TellApart brings deep expertise in performance advertising, driving cost-effective return on investment through dynamic product ads and email marketing for clients like Neiman Marcus, Pottery Barn, Sur la Table, Wayfair, and many others! With continued investments in R&D and infrastructure, as well as direct access to more data, and expansion through our global sales teams--we believe we can extend TellApart's services internationally and to industries beyond retail.
Platform Infrastructure:
In the Infrastructure team, our work directly impacts hundreds of millions of consumers, drives billions in top-line revenue for our clients, and operates at a massive scale (with an uptime in excess of 99.9%). We solve complex problems involving distributed systems (lambda architecture), service-oriented architectures, high-velocity streaming, resource management, storage, cloud infrastructure, etc. We hack a lot and try to release our work to the open source community as much as possible.
Data Platform:

We own all of the technical underpinnings of TellApart's infrastructure team. Every production system we've ever built feeds into the data platform (where we have PB's of batch-processed data under management), and we are also responsible for the streaming infrastructure for TellApart as well. Our team is also very active in the open source community =)

Software Engineer (more senior role: Sr. Software Engineer ):

Current Focus:
Build, extend and maintain the key infrastructure that powers the TellApart platform Build the next generation of high performance, highly available, distributed systems Make significant architectural decisions about the next generation of TellApart infrastructure Take ownership of key components of the architecture that power the TellApart suite of products Recently Completed Projects:
Built an identity management platform which associates a single user identity across devices and supports an anonymous profile service to derive attributes like gender and purchase preferences from their user history
Built a data pipeline which ingests > 100M user activities per day and creates a cumulative user history for use in training models and building datasets for real-time usage
Built a pluggable monitoring platform that allow users and services to retrieve, compare and alert on metrics recorded in OpenTSDB, Cloudwatch and other metric stores
Built query system from Spark, Tachyon and Parquet that caches Terabytes of data in memory and increased our query speeds by 100x. We offered contributions back to all projects in the course of development
Built a data extraction framework to enable simple and consistent data extraction from complex structures across multiple Map/Reduce platforms such as Hadoop, Hive and Spark

Requirements:
2+ years of industry experience building large-scale, distributed, high-volume systems (with Python, Java, and/or C++) (internships count toward this requirement) Good understanding of multi-threading, scaling, concurrency, caching, queuing, RPC, and distributed data storage Ability to mentor others and thrive in a dynamic, fast-paced, collaborative, and high-growth start-up environment Strong attention to detail with a predilection toward automating almost everything Bonus Points:
Experience working with the Lambda Architecture and systems like Hadoop, MapReduce, HBase, Hive, Voldemort, Azkaban, Kafka, Spark, etc. Architecting and deploying asynchronous work queues, high-volume storage systems, and high-throughput systems excites you Active contributor / committer to a well-known open source project and/or interest to do so in the future Demonstrated ability to excel in whatever you pursue (whether it's work, school, competitions, open source contributions, personal projects, etc.--you've always stood out and succeeded)

About Twitter

Twitter Inc. was founded in 2006 and has grown rapidly to more than 6 million users. The company has recently gotten plenty of Hollywood buzz as A-list actors sign up and post tweets to control their image, widen their appeal and communicate directly with fans.