The University of California, Berkeley, is one of the world's most iconic teaching and research institutions. Since 1868, Berkeley has fueled a perpetual renaissance, generating unparalleled intellectual, economic and social value in California, the United States and the world. Berkeley's culture of openness, freedom and acceptance-academic and artistic, political and cultural-make it a very special place for students, faculty and staff.
Berkeley is committed to hiring and developing staff who want to work in a high performing culture that supports the outstanding work of our faculty and students. In deciding whether to apply for a staff position at Berkeley, candidates are strongly encouraged to consider the alignment of the Berkeley Workplace Culture with their potential for success at http://jobs.berkeley.edu/why-berkeley.html.
Application Review Date
The First Review Date for this job is: 4/2/14
The AMPLab was awarded a five-year $10M, NSF "Expeditions in Computing" program grant. The director is Michael Franklin, co-principal investigators are Michael Jordan, Scott Shenker and Ion Stoica. The founding group included eight faculty members and dozens of Ph.D. students who were backed by 18 industry titans, including Google, Amazon Web Services and SAP. AMP researchers expect to develop powerful new tools to help extract key information from Big Data, a term coined for the dizzying array of measurements, images, audio, video, tweets, texts and more that has grown ever larger, faster and more diverse.
The Defense Advanced Research Projects Agency (DARPA) XDATA project is developing an open source software library for big data to help increase the impact of government investments. The Berkeley Data Analytics Stack (BDAS), comprised of systems like Apache Spark, Shark and Tachyon, is a crucial component of this DARPA library with numerous teams depending on our stack to power their applications.
The AMPLab is looking for a Solutions Architect to work with DARPA teams as they design, develop and deploy applications built on our stack. We are seeking an exceptional individual with strong client consulting experience, a working knowledge of setting up and running Hadoop clusters and knowledge of distributed systems.
The qualified candidate in this position will spend the majority of their time working with the core software engineering team on the UC, Berkeley campus. In the summer, DARPA has workshops with team's across the U.S. meeting to integrate and build data analysis systems on site in Washington D.C. These systems are often demoed within DARPA and to other government agencies such as the Pentagon. Berkeley will pay for all travel and provide long-term housing in Washington D.C. There may also be very occasional travel to D.C. to work with the DARPA infrastructure teams to roll out new software or help debug application issues.
1. THIS IS A TWO-YEAR CONTRACT POSITION
2. APPROXIMATELY 25% OF YOUR WORK TIME (2-3 MONTH'S) WILL BE PERFORMED IN WASHINGTON D.C. DURING THE SUMMER . AIRFARE, CORPORATE HOUSING, AND TRANSPORTATION WILL BE SET-UP AND PROVIDED.
3. DAILY PER DIEM FOR FOOD AND INCIDENTALS.
4. ABILITY TO FLY TO WASHINGTON D.C. THROUGHOUT THE YEAR.
5. FLEXIBLE WORK SCHEDULE /POSITION ALLOWS FOR TELECOMMUTING
50% Software development - including profiling and understanding existing software programs as well as the development of new software programs for DARPA.
20% Work with DARPA teams during their software design process to help them build the best system for their particular application. Requires an understanding of distributed computing, Hadoop and the Berkeley Data Analytics Stack (BDAS). Training on the BDAS is available.
10% Assist the DARPA operations team in the deployment of new or upgraded applications built on the Berkeley stack.
10% Debug performance or correctness issues and relay findings to AMPLab engineering team and/or open-source community.
10% Build demo systems and applications using the Berkeley stack to be presented at special DARPA event's that occur once or twice a year. These events allow DARPA to showcase the systems and applications being developed with other government agencies.
- Working knowledge of setting up and running Hadoop clusters
- Knowledge on how to create and debug Hadoop jobs
- Consulting background and/or comfort in working with customers
- Demonstrated experience gathering and understanding customer business requirements
- Familiarity with data warehousing concepts
- Knowledge of distributed systems
- Knowledge of complex data pipelines and ETL
- Knowledge of common ETL packages / libraries
- Understanding of configuration management systems (e.g. Puppet, Chef) and concepts behind mass configuration
*************Experience with most of the following**************
- Concurrency and synchronization
- Fallacies of distributed computing
- Common IPC/RPC methods and patterns
- High availability and business continuity
- Queuing patterns and pipeline design
- Batch operations
- Messaging systems and patterns
- Solid OS / networking fundamentals
- Optimization and troubleshooting
- System administration knowledge
- L2 vs. L3 networking, network architecture, VLANs, hardware device design basics
- Must be self-motivated, work independently or as part of a team, able to learn quickly, meet deadlines and demonstrate problem solving skills.
- Background check required.
Salary & Benefits
The salary range designated for this position: $70,000-115,000; however, starting salary will be commensurate with experience.
For information on the comprehensive benefits package offered by the University visit:
How to Apply
Please submit your cover letter and resume as a single attachment when applying.
Criminal Background Check
This position has been designated as sensitive and may require a Criminal Background Check. We reserve the right to make employment contingent upon successful completion of a Criminal Background Check.
This position requires the final candidate to successfully pass an E-Verify check.
To learn more information visit:
Equal Employment Opportunity
The University of California is an Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability, or protected veteran status. For the complete University of California nondiscrimination and affirmative action policy see:
If you'd like more information about your EEO rights as an applicant under the law, please see:
About University of California Berkeley
About UC Berkeley
UC Berkeley is renowned worldwide for the distinction of its faculty and students, the scope of its research and publications, and the quality of its libraries. Its academic departments consistently rank among the top five in the country. The faculty, renowned for both teaching and scholarship, includes seven Nobel Laureates and 28 MacArthur Fellows. Library facilties are excellent and can be accessed remotely. The UC Berkeley Library collection contains more than nine million volumes. Traditional library materials are supplemented with electronic databases, books, and journals.