Recent Posts all posts

Python Scheduling Suppose you wanted to build a tool which informs you whenever there is an update to a couple of websites you're interested in. And lets say the last-modified header was usable for this (it is not, but I want to focus on another problem). So you would need to save … Read More »

Scraping with Selenium Selenium is a framework for testing web applications. And it is relly good for scraping JavaScript heavy websites. The idea is that you get a real browser to execute everything. In contrast to BeautifulSoup where you only fetch the content of a website. Installation pip install selenium chromedriver_installer Basic example … Read More »

Ideen zur Verbesserung des KIT I've studied 3 years for the bachelors degree and for 2.5 years for the masters degree at KIT (Karlsruhe Institute of Technology). I had a very good time and learned a lot. In this post I point out some ideas how KIT could be a better university for bachelors … Read More »

The JavaScript World This is likely to grow. Angular FrontendFramework MVC TypeScript-based front-end web application framework by Google Express.js BackendFramework A framework for Node.js designed for building web applications and APIs. Gulp.js Tool build system / task runner in front-end web development, used for automation of tasks like minification … Read More »

Data Serialization Transforming objects you have in memory into a structure which can be stored in a file is called serialization. Serializing data is important for several reasons: Checkpoints: Especially in machine learning, it happens often that the preprocessing takes long. The longest setup I had so far was something like 20 … Read More »

Strings Strings are essential for developing applications. Yet they are not covered (enough) if you study computer science. In this article, I will explain what a string is, what Unicode, UTF-8, ASCII and encodings are and what their relationship is. Just when I was about to finish this, I found Joel … Read More »

Data Visualization with Python Python has a lot of libraries for data visualization and I recently stumbled over an awesome talk which gives an overview over them: Matplotlib seaborn: statistical data visualization Pandas: Dataframes networkx: Graphs ggpy: Python implementation of the grammar of graphics Yellow Brick scikit-plot Datashader: Turns even the largest data into … Read More »

The Reuters Dataset Reuters is a benchmark dataset for document classification. To be more precise, it is a multi-class (e.g. there are multiple classes), multi-label (e.g. each document can belong to many classes) dataset. It has 90 classes, 7769 training documents and 3019 testing documents. It is the ModApte (R(90 … Read More »

Document Classification This article explains how to classify texts. Suppose you have a text classification problem. For example, you want to classify incoming emails as (C1) spam (C2) notifications (C3) personal. Hence each email belongs to exactly one of three classes. Basic Setup Suppose you have corpus of 1000 emails. You make … Read More »

Design Most people think about really fancy things when they hear "design". Some think about Apple products, websites or art. When I say design, I mean it as a very general concept. For this article, I mean usability. How to structure things. And things could be websites or phones, but also … Read More »