Some months ago, I started a new job as a machine learning engineer for a german trading company. In the course of this, I began to deal more with the programming language Scala. Scala provides some benefits that makes the work easier for data engineers when building data pipelines and there's a good support for spark, which is an advantage in cluster computing. But Scala (of course) also has its idiosyncrasies. This article shows the idiosyncrasy of Yate's correction in the Statistcs package of Scala and its consequences. The Statistics Package Like many other programming languages, Scala also comes with a statistical package called "Statistics". It includes many basic methods of the describing statistics, which you need for many purposes. One of these purposes is, for example, A/B testing. So, what's wrong with Scala? For an A/B test, I tested the significance by own calculations first (in old manner, as I had learned in my studies) before using th...
Information about programming, data analytics, deep learning and other topics