Codevian Technologies Pvt. Ltd.

Hadoop reporting platform (freelancer / consultant)

Pune, India

codevian Technology logo

Job Description

  • Install, configure and maintain enterprise hadoop environment.
  • Loading data from different datasets and deciding on which file format is efficient for a task. Hadoop developers source large volumes of data from diverse data platforms into Hadoop platform.
  • Understanding the requirements of input to output transformations.
  • Hadoop developers spend lot of time in cleaning data as per business requirements using streaming API’s or user defined functions.
  • Defining Hadoop Job Flows.
  • Build distributed, reliable and scalable data pipelines to ingest and process data in real-time. Hadoop developer deals with fetching impression streams, transaction behaviours, clickstream data and other unstructured data.
  • Managing Hadoop jobs using scheduler.
  • Reviewing and managing hadoop log files.
  • Design and implement column family schemas of Hive and HBase within HDFS.
  • Assign schemas and create Hive tables.
  • Managing and deploying HBase clusters.
  • Develop efficient pig and hive scripts with joins on datasets using various techniques.
  • Assess the quality of datasets for a hadoop data lake.
  • Apply different HDFS formats and structure like Parquet, Avro, etc. to speed up analytics.
  • Build new hadoop clusters
  • Maintain the privacy and security of hadoop clusters.
  • Fine tune hadoop applications for high performance and throughput.
  • Troubleshoot and debug any hadoop ecosystem run time issues.
Job Information
Work Experience
8 to 10yrs
Salary
Best in industry
Start Date
Immediate
Location
Remote
Qualification

Any

only accept .pdf, .doc, and .docx file

More Opportunities

Remote (But only kerala candidates)
A front-end engineer builds the client-side of websites and applications—everything that users see, click, and interact with on their screens....
01 October 2026
Pune – Baner
You'll be responsible for generating qualified leads, building a sales pipeline, and supporting deal closures through outbound prospecting and inbound lead management primarily via email,...
30 September 2026
Bengaluru, Hyderabad, Pune, Mumbai, Noida, Chennai, Gurugram, Delhi.
An Oracle Fusion HCM Functional Consultant bridges the gap between an organization's Human Resources needs and Oracle's Cloud software, configuring modules like Core HR, Payroll,...
30 September 2026
Accredited By

Got a Project Idea?
Talk to Our Experts!

Request a quote

customer

Thanks for contacting us

Our team will get back to you soon.