ETL SDET with Pyspark Coding Experience Job at Lorven technologies, Remote

NkU0a2ZrMG1RTDhaWVk5aVlBWkhDc3F4SUE9PQ==
  • Lorven technologies
  • Remote

Job Description

ETL SDET with Pyspark Coding Experience - NYC, NY (Remote)

Must-Have Skills:

  • PySpark Coding Experience
  • Python
  • AWS S3, Redshift
  • Complex SQL
  • ETL Testing

Good to Have:

  • Kafka, Shell scripting, Healthcare domain

Note: Only ETL SDET profiles will be considered.

Position Summary

The SDET Software Development Engineer in Test is responsible for ensuring the quality and reliability of ETL processes and data integration workflows This role involves designing and implementing automated tests to validate data transformation and migration as well as collaborating with data engineers and developers to identify and resolve data quality issues The ideal candidate will leverage their expertise in ETL testing and data validation to enhance the overall data pipeline performance and integrity

Minimum Qualification

At least 10 years of IT experience with minimum 5 years of experience in below skills

Tech Skills

Proficiency in ETL Testing and developing automation framework testcases in atleast one scripting language

Experience in Pypark is Mandatory

  • Strong SQL skill with experience in handling big data using ETL tools eg Informatica
  • Testing experience in cloud environment AWS s3
  • Experience with Test Automation and DevOps practices in ETL and Cloud
  • Experience providing testing oversight in Agile team
  • Should have excellent business communication to interact with Business teams and crossfunctional teams

Responsibilities

  • Review requirements specifications and technical design documents to understand and feedback
  • Experience in developing and implementing test strategies for complex initiatives
  • Estimate prioritize plan and coordinate testing activities
  • Create automation test framework
  • Design develop and execute automation scripts
  • Identify record document thoroughly and track bugs
  • Strong problem solving skills troubleshooting and root cause analysis skills
  • Perform thorough regression testing when bugs are resolved
  • Develop and apply testing processes for new and existing features to meet client needs
  • Liaise with cross functional teams to identify system requirements
  • Track quality assurance metrics like defect densities and open defect counts
  • Stay up to date with new testing tools and test strategies requirements

  • Support and guide junior team members

Job Tags

Hourly pay, Permanent employment, Full time, Internship, Seasonal work, Remote work,

Similar Jobs

Clearview Building Maintenance

Janitorial Floater- Full time nights Job at Clearview Building Maintenance

 ...Maintenance Inc. is a woman owned commercial cleaning company expanding throughout MidMichigan....  ...* Availability to work a late second shift. * Eligibility to drive company...  ...* Evening shift* Monday to Friday* Night shift* Some weekendsAbility to commute... 

Beaver Creek Ski Resort

Experienced Ski Lift Electrical Technician Job at Beaver Creek Ski Resort

 ...with teammates and guests from around the world. With 40+ resorts across 3 continents, you can join our team for a season or stay...  ...compensation rates in the industry, free Epic pass(es) along with free ski and snowboard lessons, 40% retail discounts, the chance to grow... 

GreenLife Healthcare Staffing

Pediatric Nurse Practitioner Job at GreenLife Healthcare Staffing

 ...Pediatric Nurse Practitioner (Bilingual Spanish) - Bronx, NY (#3134) Location: Bronx, NY Employment Type: Full-time Salary: $150,000 - $160,000 per year (negotiable) About Greenlife Healthcare Staffing: Greenlife Healthcare Staffing is a leading nationwide... 

Georgia-Pacific LLC

Electrical Maintenance Technician - San Leandro, CA Job at Georgia-Pacific LLC

 ...This position offers a competitive benefits package and hourly rate of $48.26 Georgia-Pacific has an immediate opening for an Electrical Technician at our San Leandro, CA facility. Are you committed to safety? Do you enjoy working in a team environment? If this... 

Immersive1st

Camp Director - Premier Overnight Summer Camp Job at Immersive1st

 ...Top 3 Reasons to Join Us Impactful Leadership: Lead a respected overnight summer camp in the Northeast, delivering life-changing experiences for campers while fostering a culture of fun, safety, and personal growth. Strategic Growth Opportunity: Oversee a large...