Data Engineering Tech Lead - Hadoop Job at Cloud Analytics Technologies LLC, Cleveland, OH

Nzg1VENBR20zZ0FrYVRocm91dHB0cGRrUHc9PQ==
  • Cloud Analytics Technologies LLC
  • Cleveland, OH

Job Description

Key Roles & Responsibilities

  • Lead and oversee the end-to-end design, implementation, and optimization of  data pipelines supporting key customer onboarding, transaction, and decisioning workflows.
  • Architect and implement  data ingestion, transformation, and storage frameworks leveraging  Hadoop Avro , and distributed data processing technologies.
  • Partner with product, analytics, and technology teams to translate business requirements into scalable data engineering solutions that enhance real-time data accessibility and reliability.
  • Provide  technical leadership and mentorship to a team of data engineers, ensuring adherence to coding, performance, and data quality standards.
  • Design and implement robust data frameworks to support next-generation customer and business product launches.
  • Develop best practices for  data governance security , and  compliance aligned with enterprise and regulatory requirements.
  • Drive optimization of existing data pipelines and workflows for improved efficiency, scalability, and maintainability.
  • Collaborate closely with analytics and risk modeling teams to ensure data readiness for predictive insights and strategic decision-making.
  • Evaluate and integrate emerging data technologies to future-proof the data platform and enhance performance.

Must-Have Skills

  • 8–10 years of experience in  data engineering , with at least 2–3 years in a technical leadership role .
  • Strong expertise in the  Hadoop ecosystem (HDFS, Hive, MapReduce, HBase, Pig, etc.).
  • Experience working with  Avro Parquet , or other serialization formats.
  • Proven ability to design and maintain  ETL / ELT pipelines using tools such as  Spark Flink Airflow , or  NiFi .
  • Proficiency in  Python Scala for large-scale data processing.
  • Strong understanding of  data modeling data warehousing , and  data lake architectures.
  • Hands-on experience with  SQL and both  relational and  NoSQL data stores.
  • Cloud data platform experience with  AWS .
  • Deep understanding of  data security compliance , and  governance frameworks .
  • Excellent problem-solving, communication, and leadership skills.

Job Tags

Similar Jobs

Exclusive Wireless, Inc.

T-Mobile Retail Assistant Manager Job at Exclusive Wireless, Inc.

 ...at the forefront of wireless communications then WE WANT YOU! Be unique, bold, confident, reliable and excited as a part of the T-MOBILE brand! The Wireless Industry is booming and now is the time to join the movement. Our mission is to provide exceptional service... 

Stone Center

Yard Worker / Forklift Driver Job at Stone Center

 ...stone orders, load and unload trucks, maintain and organize yard and warehouse areas, and assist customers/sales staff. Forklift and Bobcat experience required. Yard Worker requirements:* Maintains positive and respectful attitude while working independently... 

Clark's - Menlo Park

Executive Sous Chef Job at Clark's - Menlo Park

About Clarks Oyster Bar: We are thrilled to announce that Clark's Oyster Bar, a proud member of MML Hospitality, will debut in Menlo Park, California, in 2025. As we gear up to introduce our unparalleled culinary experience to this picturesque locale, we begin the ...

CITY OF YORK

Recreation Coordinator Job at CITY OF YORK

 ...Job Title : Recreation Coordinator Department : Parks and Recreation Location : City of York, Nebraska Salary Range : $52,550 - $70,422 annually (Based on Experience and Qualifications) Employment Type : Full-Time, Exempt Application Deadline : Applications... 

Good Samaritan

RN - Registered Nurse - Straight Nights, Straight Weekends Job at Good Samaritan

 ...below. Join our not-for-profit organization that has provided over 100 years of housing and services to seniors with a commitment to quality care and service in a Christian environment. Facility: GSS SD Tyndall Ctr Location: Tyndall, SD Address: 2304 Laurel St, Tyndall,...