Big Data Developer / Big Lake
Location: Basking Ridge, NJ or Boston, MA
Duration: 6+ month contract to hire (USC AND GC AND GC EAD)
Interview process: Phone, Skype
Client: UHG/Optum technologies
Req. # 15-02011
Project; Big data platform Data Lake
Responsibilities:
- Provide hands-on leadership for the design and development of ETL data flows using Hadoop and Spark ECO system components. Leading the develop of large-scale, high-speed, and low-latency data solutions in the areas of large scale data manipulation, long-term data storage, data warehousing, low-latency retrieval systems, real-time reporting and analytics Data applications - visualization, BI, dashboards, ad-hoc analytics
- Design & implement work flow jobs using Talend & Unix / Linux scripting to perform ETL on Hadoop platform
- Translate complex functional and technical requirements into detailed design
- Perform analysis of data sets and uncover insights
- Maintain security and data privacy
- Propose best practices/standards
- Work with the System Analyst and development manager on a day-to-day basis
- Work with other team members to accomplish key development tasks
- Work with service delivery (support) team on transition and stabilization
- Design and develop optimal solutions for the implementation, maintenance and monitoring of all components of software
- Responsible for integrating all development with the architecture used across the company
- Help shape and augment team's continuous delivery capabilities and utilize DevOps best practices to improve delivery automation, collaboration, and efficiency
- Design and develop ETL data flows using Hive / Pig.
- Loading from disparate data sets.
- Pre-processing using Hive and Pig.
- Translate complex functional and technical requirements into detailed design.
- Perform analysis of data sets and uncover insights.
- Maintain security and data privacy.
- Implement data flow scripts using Unix / hive / pig scripting.
- Propose best practices/standards.
- Work with the System Analyst and Development Manager on a day-to-day basis
- Work with other team members to accomplish key development tasks
- Work with service delivery (support) team on transition and stabilization
Required Software / Tools:
- We are looking for a Lead Big Data Developer who will lead and work on the collecting, storing, processing, and analyzing of huge sets of data.
- The primary focus will be on choosing optimal solutions to use for these purposes, then maintaining, implementing, and monitoring them.
- You will also be responsible for integrating them with the architecture used across the company.
- Individual should have expertise and at least 5 years of hands-on experience in Java Enterprise ecosystem (Design, Development, Test, Deploy on Production) is required.
- At least 4 years of hands-on experience with Hadoop/Hive/MapReduce/Pig/Sqoop/Flume (Design, Development, Test, Deploy on Production Hadoop cluster) , demonstrated ability to segment and organize data from disparate sources and knowledge of data security and encryption models is desirable.
- Experience working with Hadoop/HBase/Hive/MRV1/MRV2 & ETL processing with HIVE/Pig scripts is required.
- Demonstrate experience in implementing Unix scripting is required.
- Any experience is health care insurance industry is a plus.
Preferred Qualifications:
· Team lead experience
· ETL development experience
· ETL data flows experience
· Apache Spark
· Talend experience
· Unix/Linux Scripting experience
· Shell Scripting experience
· Python experience
· HBase experience
· NoSQL experience
· Scala experience
· JSON experience
· REST experience
· Sqoop experience
· Flume experience
· Data warehouse implementation experience
Umang Agarwal
Sr.Technical Recruiter
SriMatrix Inc
1255 West 15th Street, Suite 815
Plano, TX 75075
A Certified Minority & Woman Owned Business Enterprise (MWBE)
Ph No: 732-902-0873
Privacy Policy | Under Bill 1618 Title III passed by the 105th USA Congress this eMail cannot be considered as spam as long as we include our contact information and an option to be removed from our eMailing list. If you have received this message in error or, are not interested in receiving our eMails, please reply with Remove/Unsubscribe in subject line of this eMail and we will Remove your email from our list immediately .
You received this message because you are subscribed to the Google Groups "CVMSCRM" group.
To unsubscribe from this group and stop receiving emails from it, send an email to cvmscrm+unsubscribe@googlegroups.com.
To post to this group, send email to cvmscrm@googlegroups.com.
Visit this group at https://groups.google.com/group/cvmscrm.
For more options, visit https://groups.google.com/d/optout.
No comments:
Post a Comment