hirq
← All jobs

Ventures Unlimited Inc

Hadoop Lead

Beaverton, OR, us · On-site · Full-time

Apply well, not just fast

Create a free account and upload your resume to get a match score, keyword gaps, a tailored resume, a cover letter and interview prep for this job.

About the role

HadoopPythonJavaETLData WarehousingSQLBashRKafkaCassandraMachine LearningStatistics
Ventures Unlimited is a service centric organization. Our success begins with our ability to apply our relationships, leverage technologies, and identify talent - often in combination - to an endless array of real-world customer needs                                             **** FULL TIME PERMANENT POSITION****** Position : Hadoop Lead with Python Location:  Beaverton, OR Duration: Full Time Job Description :  Responsibilities: •    Design and implement map reduce jobs to support distributed processing using java, python, hive and pig; Ability to design and implement end to end solution. •    Build libraries, user defined functions, and frameworks around Hadoop •    Research, evaluate and utilize new technologies/tools/frameworks around Hadoop eco system •    Develop user defined functions to provide custom hive and pig capabilities •    Define and build data acquisitions and consumption strategies •    Define & develop best practices •    Work with support teams in resolving operational & performance issues •    Work with architecture/engineering leads and other teams on capacity planning •    Work with Site-Operations team on configuration/upgrades of the cluster •    Excellent communication skills Qualification: •    MS/BS degree in a computer science field or related discipline •    8+ years’ experience in large-scale software development •    Experience  with data warehousing, dimensional modeling and ETL development •    Strong Java programming, shell scripting, Python, and SQL •    Strong development skills around Hadoop, MapReduce, Hive, Pig, Impala •    Strong understanding of Hadoop internals •    Good understanding of AVRO and Json •    Experience with build tools such as Maven •    Experience with databases like Oracle; •    Experience with performance/scalability tuning, algorithms and computational complexity •    Experience (at least familiarity) with data warehousing, dimensional modeling and ETL development •    Ability to understand and ERDs and relational database schemas •    Proven ability to work cross functional teams to deliver appropriate resolution •    Experience with open source NOSQL technologies such as HBase and Cassandra •    Experience with messaging & complex event processing systems such as Kafka and Storm •    Machine learning framework (Nice to have) •    Statistical analysis with Python, R or similar •    MS/BS degree in a computer science field or related discipline •    8+ years’ experience in large-scale software development •    Experience  with data warehousing, dimensional modeling and ETL development •    Strong Java programming, shell scripting, Python, and SQL •    Strong development skills around Hadoop, MapReduce, Hive, Pig, Impala Contact "Mohit Maurya" for more details at 856-842-1988 Ext:141