Job Description:Below are some of the responsibilities of a big data engineer:HAdoopSparkscalakafkahiveDesign the architecture of our big data platformPerform and oversee tasks such as writing scripts, calling APIs, web scraping, and writing SQL queriesDesign and implement data stores that support the scalable processing and storage of our high-frequency dataMaintain our data pipelineCustomize and oversee integration tools, warehouses, databases, and analytical systems