MLops - [Paper] Hidden Technical Debt in Machine Learning Systems

- terms

1.Static (progam) analysis : [wiki] the analysis of computer software performed without executing any programs, in contrast with dynamic analysis, which is performed on programs during their execution 

2.Pipeline jungles : scrapes, join, samplings, etc are ineffienciently used  

3.Upstream producer :

[ wiki ] sending data from clinet, local device to server 

[ blog ]  https://smallbusiness.chron.com/definitions-upstream-downstream-production-process-30971.html

 

- references

1.Compare ML platform as database : https://dokumen.tips/engineering/the-challenges-of-bringing-machine-learning-to-the-masses.html

2.Anti patterns : make right interface , remove dead exp branch / generic packages

[wiki] https://en.wikipedia.org/wiki/Anti-pattern#Programming_anti-patterns

[book] http://ce.sharif.edu/courses/96-97/1/ce475-1/resources/root/Antipatterns%20-%20Refactoring%20Software_%20Architectures_%20and%20Proj.pdf

[blog1-code level] https://alkhwa-113.tistory.com/entry/%EC%95%88%ED%8B%B0-%ED%8C%A8%ED%84%B4-%EB%82%B4-%EC%83%9D%EA%B0%81-%ED%8F%AC%ED%95%A8

 [blog2-code level] : https://it-jin-developer.tistory.com/20 

3.Data sanity check[blog] : https://alkhwa-113.tistory.com/entry/%EB%8D%B0%EC%9D%B4%ED%84%B0-%EC%9C%A0%ED%9A%A8%EC%84%B1-%EC%B2%B4%ED%81%AC?category=917479 

4.Google's hybrid approach to research :  engineers and researchers work together https://static.googleusercontent.com/media/research.google.com/ko//pubs/archive/38149.pdf