Data Engineer
1 month ago
Employment Information
Job Title: Data Engineer (Java/Spark/AWS/ETL)
Location : Columbus, OH ( need local to OH) Hybrid (3 days onsite 2 days Remote)
Duration : 6 Month
Experience:2 + year
Interview Process:
Webx Interview
Note :
LinkedIn is must
Need good profiles on this position
Job Description :
Experience: looking for a junior profile Minimum 2+ years Required
Must Have Skills :
(Java/Spark/AWS/ETL)
MUST have
- Teradata, DBMS knowledge
- ETL knowledge
- CICD and data warehouse concept
- Java & Spark
Candidates with Database knowledge & ETL knowledge will get 100% preference
Data pipeline work, sending data to data warehouse, etc – Currently set up on Java/Spark (MUST HAVE Java/Spark)
Must have Teradata and DBMS knowledge (SQL)
Must have good ETL knowledge (Abinitio or Informatica is fine)
Must have good CICD and Data Warehouse concepts
Must have good AWS experience
Postgres DB is a big plus
Snowflake is a big plus but not a must have – Team will utilize some Snowflake eventually
Python is a big plus – will eventually be moving from Java/Spark to Python/Spark
Job Responsibilities:
Required qualifications, capabilities, and skills.
Preferred qualifications, capabilities, and skills
- Execute software solutions, design, development, and technical troubleshooting with ability to think beyond routine or conventional approaches to build solutions or break down technical problems.
- Write secure and high-quality code and maintains algorithms that run synchronously with appropriate systems.
- Produce architecture and design artifacts for complex applications while being accountable for ensuring design constraints are met by software code development.
- Apply knowledge of tools within the Software Development Life Cycle toolchain to improve the value realized by automation.
- Apply technical troubleshooting to break down solutions and solve technical problems of basic complexity.
- Gather, analyze, synthesize, and develop visualizations and reporting from large, diverse data sets in service of continuous improvement of software applications and systems.
- Proactively identify hidden problems and patterns in data and uses these insights to drive improvements to coding hygiene and system architecture.
- Contribute to software engineering communities of practice and events that explore new and emerging technologies.
- Add to team culture of diversity, equity, inclusion, and respect.
Required qualifications, capabilities, and skills.
- Proven experience in understanding requirement related to extraction, transformation, and loading (ETL) of data using Spark on Cloud
- Formal training or certification on software engineering concepts and 3+ years applied experience.
- Ability to independently design, build, test, and deploy code. Should be able to lead by example and guide the team with his/her technical expertise.
- Ability to identify risks/issues for the project and manage them accordingly.
- Hands-on development experience and in-depth knowledge of Java/Python, Microservices, Containers/Kubernetes, Spark, and SQL.
- Hands-on practical experience in system design, application development, testing, and operational stability
- Experience in developing, debugging, and maintaining code in a large corporate environment with one or more modern programming languages and database querying languages.
- Proficient in coding in one or more programming languages
- Experience across the whole Software Development Life Cycle
- Proven understanding of agile methodologies such as CI/CD, Applicant Resiliency, and Security
- Proven knowledge of software applications and technical processes within a technical discipline (e.g., cloud, artificial intelligence, machine learning, mobile, etc.)
Preferred qualifications, capabilities, and skills
- Knowledge about Data warehousing Concepts.
- Experience with Agile based project methodology.
- Ability to identify risks/issues for the project and manage them accordingly.
- Knowledge or experience on ETL technologies like Informatica or Ab-initio would be preferable
- People management skills would be given preference but is not mandatory.
Skills
Data Engineer
Share this
New Things Will Always
Update Regularly
