Senior/Lead Big Data Engineer- Hadoop (Home based worker)

Work From Home
Not Specified
Mar 23, 2021
May 22, 2021
Job Type
Not Specified
Career Level
Not Specified

The world isnt standing still, and neither is Allstate. Were moving quickly, looking across our businesses and brands and taking bold steps to better serve customers evolving needs. Thats why now is an exciting time to join our team. Youll have opportunities to take risks, challenge the status quo and shape the future for the greater good.

Youll do all this in an environment of excellence and the highest ethical standards a place where values such as integrity, inclusive diversity and accountability are paramount. We empower every employee to lead, drive change and give back where they work and live. Our people are our greatest strength, and we work as one team in service of our customers and communities.

Everything we do at Allstate is driven by a shared purpose: to protect people from lifes uncertainties so they can realize their hopes and dreams. For more than 89 years weve thrived by staying a step ahead of whatevers coming next to give customers peace of mind no matter what changes they face. We acted with conviction to advocate for seat belts, air bags and graduated driving laws. We help give survivors of domestic violence a voice through financial empowerment. Weve been an industry leader in pricing sophistication, telematics, digital photo claims and, more recently, device and identity protection. We are the Good Hands. We dont follow the trends. We set them.

Compensation Data

The role pays in the range of $110,000-125,000 depending on skills and experience. D band internal applicants are encouraged to apply.

We Offer: 

    1. A culture of learning where you can expect to develop foundational skills for the future 
    2. Leadership teams that are communicative and compassionate 
    3. Impactful work by serving customers and the community in times of need 
    4. Potential for flexible work arrangements 
    5. A culture in which you dress for your day 
    6. Recognition and advancement opportunities 
    7. Paid Time Off, 401(k) and pension 
    8. Medical, Dental, and Vision coverage 
    9. Tuition Reimbursement 

You can view all Allstate benefits @ 

Job Summary

D band internal applicants are encouraged to apply

Data Science incorporates techniques across many disciplines – including mathematics/statistics, computer programming, data engineering and ETL, software development, and high performance computing – with traditional business expertise with the goal of extracting meaning from data to optimize future business decisions. Individuals in this field should be an expert/fluent in several of these disciplines and sufficiently proficient in others to effectively design, build, and deliver end to end predictive analytics products to optimize future decisions. Individual demonstrates sufficient analytic agility to quickly develop new skills across these disciplines as those disciplines evolve. Data, Discovery & Decision is responsible for aligning with and contributing to corporate objectives by identifying and developing growth and profitability opportunities that will enable Allstate to generate profitable market share growth. The Big Data Engineer job family is accountable for end to end engineering of data solutions which includes designing and building systems for data storage and analytics that enable Allstate analysts to make better decisions to achieve Allstate's goals.

This role is responsible for the delivery of Big Data solutions to make decisions. This includes the development of new systems for analyzing data; the coding & development of advanced analytics solutions to make/optimize business decisions and processes; integrating new tools to improve descriptive, predictive, and prescriptive analytics; and discovery of new technical challenges that can be solved with existing and emerging Big Data hardware and software solutions.  This role will also begin project management of moderately complex projects. This role contributes to the structured and unstructured Big Data / Data Science tools of Allstate from traditional to emerging analytics technologies and methods. The role is responsible for assisting in the selection and development of other team members.

Key Responsibilities

This role can sit remote- but the preference is in the Dallas, TX location

    Executes complex and occasionally highly complex functional work tracks for the team.  Drives the execution of operational/technical objectives for data analytic outputs and business solutions. 
    Partners with Allstate Technology teams on Big Data efforts.
    Partners closely with peers in the department to ensure holistic Big Data solutions for our data science community and analytic users.  
    With coaching, can identify new areas of data, research and big data technology that can solve business problems
    Leverages and uses Big Data best practices / lessons learned to develop technical solutions used for descriptive analytics, ETL, predictive modeling, and prescriptive “real time decisions” analytics
    Influences within the department on the effectiveness of Big Data systems to solve their business problems
    Is recognized as an expert in Big Data and is influential within the department.
    Develops technical solutions using Big Data techniques in data & analytics processes. 
    Supports Innovation; regularly provides new ideas to help people, process, and technology that interact with analytic ecosystem.
    With coaching, develops and builds frameworks/prototypes that integrate big data and advanced analytics to make business decisions.
    With coaching, implements new areas of Big Data technologies, (ingestion, processing, distribution) and research delivery methods that can solve business problems.
    Understands the Big Data related problems and requirements to identify the optimal technical approach.
    Works with key team members to ensure efforts within owned tracks of work will meet their needs. 
    Drives multiple tracks of moderately complex and occasionally complex work within the research group.
    Identifies and develops Big Data sources & techniques to solve business problems.
    Co-mingles data sources to lead work on data and problems across departments to drive improved business & technical results through designing, building, and partnering to implement models. 
    Manages various Big Data analytic tool development projects with midsize teams. 
    Executes on Big Data requests to improve the accuracy, quality, completeness, speed of data, and decisions made from Big Data analysis.
    Uses, learns, teaches, and supports a wide variety of Big Data and Data Science tools to achieve results (i.e., R, ETL Tools, Hadoop, and others).
    Uses, learns, teaches, and supports a wide variety of programming languages on Big Data and Data Science work (i.e. Java, C#, Python, and Perl)
    The development and execution of a communication strategy that keeps all relevant stakeholders informed and provides an opportunity to influence the direction of the work
    Trains and develops more junior engineers.

Job Qualifications

This role can sit remote- but the preference is in the Dallas, TX location

    3 - 4 Years of experience or equivalent skills & ability
    Master's or PhD preferred in a quantitative or scientific field such as computer science, computer engineering or equivocal experience
    Experience in using software development to drive data science & analytic efforts 
    Experience with database & ETL technologies
    Experience with various data types (e.g. Relational, Unstructured, Hierarchical, Linked “Graph” Data)
    Experience in developing, managing, and manipulating large, complex datasets
    Experience in working with statistical software such as SAS, SPSS, MatLab, R, CART, etc.
    Proven ability to code and develop prototypes in languages such as Python, Perl, Java, C, R, SQL, XSLT
    Ability to communicate and present advanced technical topics to general audiences
    Leading project teams of various skills levels 
    Understanding of predictive modeling techniques a plus

The candidate(s) offered this position will be required to submit to a background investigation, which includes a drug screen.

Good Work. Good Life. Good Hands.

As a Fortune 100 company and industry leader, we provide a competitive salary but thats just the beginning. Our Total Rewards package also offers benefits like tuition assistance, medical and dental insurance, as well as a robust pension and 401(k). Plus, youll have access to a wide variety of programs to help you balance your work and personal life -- including a generous paid time off policy.

Learn more about life at Allstate. Connect with us on Twitter, Facebook, Instagram and LinkedIn or watch a video.

Allstate generally does not sponsor individuals for employment-based visas for this position.

Effective July 1, 2014, under Indiana House Enrolled Act (HEA) 1242, it is against public policy of the State of Indiana and a discriminatory practice for an employer to discriminate against a prospective employee on the basis of status as a veteran by refusing to employ an applicant on the basis that they are a veteran of the armed forces of the United States, a member of the Indiana National Guard or a member of a reserve component.

For jobs in San Francisco, please click here for information regarding the San Francisco Fair Chance Ordinance.
For jobs in Los Angeles, please click here for information regarding the Los Angeles Fair Chance Initiative for Hiring Ordinance.

To view the EEO is the Law poster click here. This poster provides information concerning the laws and procedures for filing complaints of violations of the laws with the Office of Federal Contract Compliance Programs

To view the FMLA poster, click here. This poster summarizing the major provisions of the Family and Medical Leave Act (FMLA) and telling employees how to file a complaint.

It is the Companys policy to employ the best qualified individuals available for all jobs. Therefore, any discriminatory action taken on account of an employees ancestry, age, color, disability, genetic information, gender, gender identity, gender expression, sexual and reproductive health decision, marital status, medical condition, military or veteran status, national origin, race (include traits historically associated with race, including, but not limited to, hair texture and protective hairstyles), religion (including religious dress), sex, or sexual orientation that adversely affects an employee's terms or conditions of employment is prohibited. This policy applies to all aspects of the employment relationship, including, but not limited to, hiring, training, salary administration, promotion, job assignment, benefits, discipline, and separation of employment.

Similar jobs

More searches like this

Similar jobs