Renato Cordeiro Ferreira
Scientific Programmer @ JADS | PhD Candidate @ USP | Co-founder & Coordinator @CodeLab
Software Engineering
vs.
Data Science
Challenges and Patterns
Joseph W. Yoder is a founder and principal of The Refactory, Inc., a company focused on software architecture, design, implementation, consulting and mentoring on all facets of software development. Joseph is an international speaker and pattern author, long-standing member of the ACM, and the President of The Hillside Group, a group dedicated to improving the quality of software development.
Leonardo G. Azevedo é pesquisador da IBM Research Brazil desde 2013 e professor da Universidade Federal do Estado do Rio de Janeiro (UNIRIO) desde 2009. Tem mais de 20 anos de experiência em pesquisa e desenvolvimento de sistemas tendo atuado em diversas empresas e para o governo.
Eduardo Guerra atua profissionalmente como pesquisador no Instituto nacional de Pesquisas Espaciais (INPE) onde atuou no conselho e como coordenador interino do curso de pós-graduação em Computação Aplicada. Desenvolve pesquisa na área de desenvolvimento de frameworks, design e arquitetura de software, mineração de repositórios de software e metodologias ágeis.
Code
Data
Product
Infrastructure
Agile
Data
Science
Data
Engineering
DevOps
Agile vs. Data Science
What are the challenges of including a data scientist (with background in statistics and techniques used in the field) in a multidisciplinary team?
Agile vs. Data Science
How can a MsC / PhD in Data Science (with academic background) become a professional developer capable of making production code?
Agile vs. Data Science
What are the challenges of turning data science experiments into final products?
Agile vs. Data Science
How do data science tasks
(which involve research and experimentation) can be integrated
in the iterative development
of agile teams?
Agile vs. Data Engineering
What are the challenges of including a data engineer (with background in big data and tools used in the field) in a multidisciplinary team?
How can a developer specialize himself to become person capable of dealing with big data?
Agile vs. Data Engineering
What are the challenges of making data engineering products available to data scientists?
Agile vs. Data Engineering
How do data engineering tasks
(which involve specialized tools)
can be integrated in the iterative development of agile teams?
Agile vs. Data Engineering
DevOps vs. Data Science
What are the challenges to make
Data Science follow the same path as Operations with the arise of a movement like DevOps?
DevOps vs. Data Science
How can Continuous Delivery be used to test multiple products made with Data Science?
DevOps vs. Data Science
Can the particularities of data science tools (visual, high-level) be one of the reasons why data scientists can't make production services (which usually require high performance because of big data)?
DevOps vs. Data Science
Can the background of data scientists justify the popularity of notebooks (iPython / Jupyter) instead of scripts?
DevOps vs. Data Engineering
What are the challenges to make
Data Engineering follow the same path as Operations with the arise of a movement like DevOps?
DevOps vs. Data Engineering
What are the challenges of keeping reproducibility since big data often demands discarding data?
DevOps vs. Data Engineering
How is is possible to improve teaching / training about big data / data engineering since single developers don't have access to the infrastructure and amount of data required to have these challenges?
DevOps vs. Data Engineering
Are Big Data tools not automated enough for developers to deploy their own infrastructure (as containers and the cloud allowed nowadays)
Software Engineering is the systematic application of scientific and technological knowledge, methods, and experience to the design, implementation, testing, and documentation of software
Data Science is an interdisciplinary field that uses scientific methods, processes, algorithms and systems to extract knowledge and insights from data in various forms, both structured and unstructured
Software Engineering vs. Data Science
By Renato Cordeiro Ferreira
Software Engineering vs. Data Science
Slides for the panel "Software Engineering vs. Data Science: Challenges and Patterns" held at CBSoft 2018
