Monthly Archives: December 2016

Big Data Engineer

Big Data Engineer

2016 salary range: $129,500 to $183,500

2017 salary range: $135,000 to $196,000

Projected salary growth: 5.8%

These pros design and implement solutions for big data challenges. They gather business objectives from users and data scientists, and then they translate those objectives into data-processing workflows. They should have a strong knowledge of statistics, programming experience in Python or Java, and the ability to design and implement big data solutions. Experience with NoSQL is preferred. They should also have experience with data mining, processing large amounts of raw data, and maintaining relational databases for storage and data acquisition. These pros typically hold a bachelor’s degree in a related field and have from four to six years of experience.

C++ big data

1. map reduce

thrill(http://project-thrill.org)
hce (hadoop C++ extension)
google mr4c(https://github.com/google/mr4c)

2. fs

qfs (https://github.com/quantcast/qfs)

3. big table

hypertable (http://www.hypertable.org)

知识体系

1. C++
C++ Primer, Fifth Edition

2. Design pattern
Design Patterns Elements of Reusable Object-Oriented Software

3. multi-thread
c++ concurrency in action: practical multithreading

4. distributed algorithm
Distributed Systems An Algorithmic Approach

5. parallel algorithm
Introduction to Parallel Computing, Second Edition