
salesforce.com
Big Data Engineer
San Francisco Bay Area, US - Computer Software, Information Technology and Services, Internet
We are looking for a Big Data Engineer, experienced in working with complex data and able to both analyze the business requirements and be hands on with converting the data into business solutions. You will be responsible for designing and developing Hadoop and related big data technologies for enterprise class application.
Responsibilities:
- Participate and provide leadership in the system design and development activities focused on Big Data Analytics
- Produce and develop software in an agile environment, using modern techniques and processes (e.g., version control, bug tracking, etc.)
- Participate and lead, when required, daily agile development coordination meetings, and incorporate agile processes into development activities.
- Build libraries, user defined functions, and frameworks around Hadoop
- Develop user defined functions to provide custom hbase/hive capabilities
- Work with Operations team on upgrades of the cluster
- Work with data scientists in the business functions plus Developers to take data-centric algorithms and convert them into maintainable, scalable and high-performance solution.
- Analyze, develop, integrate, and then operationalize new data sources
- Work proactively to predict and minimize potential issues before they arise, and resolves those that do in a timely manner
Experience/Skills:
- Bachelors/Masters in Computer Science or Equivalent
- 2-3 years of relevant experience
- Working Knowledge of: Hadoop and HBase, Hive, Pig, Java, Unix/Shell Scripting, Python
- Good understanding and working knowledge of SQL and NoSQL databases.
- Experience working in an Agile environment is a preferred!
- Experience with Jenkins, Git, Kafka, Spark, Informatica, AWS is desirable
- Search Engine Development exposure or previous experience with Lucene/SOLR is desirable
- Big Data Engineering Analytics with algorithms such as Machine Learning, and Data Mining plus statistical analysis and modeling with R is a preferred!
Salesforce will consider for employment qualified applicants with criminal histories in a manner consistent with the requirements of the San Francisco Fair Chance Ordinance.
No salary provided
Posted December 29, 2014 at 01:26AM from LinkedIn https://www.linkedin.com/jobs?viewJob=&jobId=18799543&trk=api*a130653*s139051*
via IFTTT
No comments:
Post a Comment