Marek’s Dev Diary: April 4, 2025

What is this Every Thursday, I will share a dev diary about what we’ve been working on over the past few weeks. I’ll focus on the interesting challenges and solutions that I encountered. I won’t be able to cover everything, but I’ll share what caught my interest. Why am I doing it I want to bring our community along on this journey, and I simply love writing about things I’m passionate about! This is my unfiltered dev journal, so please keep in mind that what I write here are my thoughts and will be outdated by the time you read this, as so many things change quickly. Any plans I mention aren’t set in stone and everything is subject to change. Also, if you don’t like spoilers, then don’t read this. Space Engineers 2 We released a much requested set of blocks this week šŸ˜‰ The team is working on VS 1.2, VS 1.5 and VS 2, but I was focusing on other projects this week so I don’t have that many SE2 updates We tweaked the ‘acceleration-based camera shake’ feature, which creates camera movement proportional to acceleration. Higher acceleration produces more shake.The feature is disabled for standard walking/running movements...
Read more

Ensuring Accurate Data Annotation for AI...

A robust AI-based solution is built on data – not just any data but high-quality, accurately annotated data. Only the best and most refined data can power your AI project, and this data purity will have a huge impact on the project’s outcome. At the core of successful AI projects lies data annotation, the process of refining raw data into a format that machines can understand. However, the process of preparing training data is layered, tedious, and time-consuming. From sourcing data to cleaning, annotating, and ensuring compliance, it can often feel overwhelming. This is why many organizations consider outsourcing their data labeling needs to expert vendors. But how do you ensure both accuracy in data annotation and choose the right data labeling vendor? This comprehensive guide will help you with both. Why Accurate Data Annotation is Critical for AI Projects We’ve often called data the fuel for AI projects – but not just any data will do. If you need ā€œrocket fuelā€ to help your project achieve liftoff, you can’t put raw oil in the tank. Data needs to be carefully refined to ensure that only the highest-quality information powers your project. This refinement process, known as data annotation, is...
Read more

Learning like the human mind

The rapid advancement of artificial intelligence has led to increasingly sophisticated models, yet these systems still face fundamental efficiency challenges. A team of researchers led by Dr. Suin Yi, Assistant Professor at Texas A&M College of Engineering, has developed a new approach called Super-Turing AI, which mimics the human brain’s ability to learn and adapt. This innovation could greatly improve AI by significantly reducing computational costs and energy consumption. Current AI models rely on architectures that separate data storage from processing, requiring enormous computational power and energy to migrate information between these two components. In contrast, the human brain integrates learning and memory through neural connections called synapses, which dynamically strengthen or weaken based on experience – a process known as synaptic plasticity. Dr. Yi’s team has taken inspiration from neuroscience to develop AI systems that function more like biological brains. Traditional AI models depend heavily on backpropagation, an optimization algorithm used to adjust neural networks during training. While effective, backpropagation is computationally intensive and biologically implausible. To address this, the team explores alternative mechanisms such as Hebbian learning – often summarized as ā€œcells that fire together, wire togetherā€ – and spike-timing-dependent plasticity (STDP). These biologically inspired learning processes allow...
Read more

The Batch Normalization layer of Keras...

April 17, 2018 Vasilis Vryniotis . 31 Comments UPDATE: Unfortunately my Pull-Request to Keras that changed the behaviour of the Batch Normalization layer was not accepted. You can read the details here. For those of you who are brave enough to mess with custom implementations, you can find the code in my branch. I might maintain it and merge it with the latest stable version of Keras (2.1.6, 2.2.2 and 2.2.4) for as long as I use it but no promises. Most people who work in Deep Learning have either used or heard of Keras. For those of you who haven’t, it’s a great library that abstracts the underlying Deep Learning frameworks such as TensorFlow, Theano and CNTK and provides a high-level API for training ANNs. It is easy to use, enables fast prototyping and has a friendly active community. I’ve been using it heavily and contributing to the project periodically for quite some time and I definitely recommend it to anyone who wants to work on Deep Learning. Even though Keras made my life easier, quite many times I’ve been bitten by the odd behavior of the Batch Normalization layer. Its default behavior has changed over time, nevertheless it...
Read more

From Weeks to Days: AI-Powered Precision...

From Weeks to Days: AI-Powered Precision in Loan Automation5 min read Reading Time: 4 minutes The old-school, paper-heavy loan processing methods are like using a flip phone in the age of smartphones—outdated and frustrating. Customers today want their loans approved faster than they can brew a cup of coffee, and frankly, who can blame them?Ā  Lengthy approvals, outdated systems, and high costs aren’t just inconvenient—they’re deal-breakers. As customers crave quicker, smoother, and more personalised experiences, banks are left with one choice: evolve or get left behind.Ā  Our AI platform helps financial institutions streamline data across departments, replacing complex, costly systems with adaptive workflows that grow with your business. According to McKinsey & Company, a staggering 80% of IT budgets are tied up just keeping the old systems running. That leaves little room for anything new or exciting. Meanwhile, drawn-out loan application processes are driving customers away in droves—52% of them, to be exact. So, what’s a forward-thinking financial institution to do? Enter AI-driven automation. Imagine cutting down those agonizing wait times, slashing operational costs, and still delivering a top-notch customer experience. Sounds like a dream, right? Well, it’s not. It’s the new reality for agile financial institutions that are embracing...
Read more

Legacy Data Strategy: The AI Bottleneck

Tech companies have been racing to integrate AI across products and processes, but many of those efforts hit walls that are not immediately obvious. The excitement is there. The models are available. The compute power exists. Yet progress stalls. What often goes unnoticed is the real blocker: data. Not the lack of it, but the way it is organized, accessed, and governed. Most tech teams still rely on legacy data systems and fragmented strategies built for a different era, long before AI pipelines, real time decisions, or large language models entered the picture. The result? Long ramp up times, underperforming models, and AI initiatives that never reach production. This is not a tooling issue. It is a foundational problem. And until data strategy catches up, even the best AI ideas will remain stuck in neutral. Want guidance from an AI and Data experts on how to implement AI in your business? Contact Fusemachines today! How Legacy Data Strategies Create Invisible Friction Legacy data systems were never designed with AI in mind. They evolved over time to support transactional workloads, reporting, and disconnected business functions not fast moving AI pipelines. In many tech companies, data still lives in separate systems maintained...
Read more

Recipes – MetaDevo

Food recipes, that is. But cooking is kind of like programming and other computer efforts, isn’t it? Although it might not seem obvious, there is a very close connection between Coding and Cooking, as they are similar in many ways, to name a few they both need creativity, and have a solid foundation from where they develop their activity. You can just follow a recipe, but in order to re-interpret traditional dishes, some inventiveness is required. In coding you can create a programme based on an instruction set or you can remix a project using your imagination. Sky is the limit! —Stefania Altieri Aside from coding, when I first figure out a manual sequence of steps, for example to configure a Linux OS for a specific task, or how to get something deployed, I refer to it as a ā€œrecipeā€ at least until it’s scripted and/or automated. As I cook more and learn more dishes—and start having personal preferences for certain ingredients—I’ve started putting them in a repository on Github: https://github.com/samrecipes/recipes A lot of my current recipes started by looking at various websites and combining them together. And then specializing it for my own whims and typical ingredients I have...
Read more

Future of Natural Language Processing with...

I recently attended a talk by Kevin Clarke (CS224n) where he talked about the future trends in NLP. I am writing this post to summarize and discuss the recent trends. Slide snippets are from his guest lecture. There are 2 primary topics that lay down the trends for NLP with Deep Learning:1. Pre-Training using Unsupervised/Unlabeled data2. OpenAI GPT-2 breakthrough 1. Pre-Training using Unsupervised/Unlabeled data Supervised data is expensive and limited, how can we use Unsupervised data to supplement training with supervised fine-tuning to do better? Let’s apply this to the problem of Machine Translation and see how this helps – If you have 2 corpus of text (transcriptions or wikipedia articles) in different languages with no cross language mapping. We can use this for pre-training, train an encoder and decoder LSTM (without attention) individually on both corpus and fit them together in a model and fine-tune over a labeled dataset.Ā  How does this help? Both the encoder and decoder LSTMs here have learnt the notion of their respective language distributions and are good as generative models for each of their languages. When you put them together (#2) the model learn to use the compressed representation and map them from source...
Read more

First-of-a-kind electronic skin mimics human pain...

Ā  Electronic skins that perform the same sensory functions as human skin could mean big things for the fields of robotics and medical devices, and scientists are not solely focused on just the pleasant ones. Researchers in Australia have succeeded in developing an artificial skin that responds to painful stimuli in the same way real skin does, which they see as an important step towards intelligent machines and prosthetics. It mightn’t seem like the most practical of goals, but researchers have been working to develop electronic skins that allow robots and prostheses to feel pain for quite some time. These technologies could enable amputees to know if they areĀ picking up something sharp or dangerous, for example, or could makeĀ robots more durable and safer for humans to be around. The researchers behind the latest breakthrough, from Australia’s Royal Melbourne Institute of Technology, believe they have created a first of-a-kind device that can replicate the feedback loop of painful stimuli in unprecedented detail. Just as nerve signals travel to the brain at warp speed to inform it that we’ve encountered something sharp or hot, the new artificial skin does so with great efficiency, and with an ability to distinguish between less and...
Read more

An Overview of Chinese AI Tigers...

The recent disruption caused by DeepSeek’s R1 model sent shockwaves through the AI community, demonstrating that Chinese AI advancements may have been underestimated. The model’s performance, rivaling some of the most advanced offerings from OpenAI and Anthropic at a fraction of the cost, signaled a new era of competition in artificial intelligence. However, DeepSeek is not the only Chinese company making waves in AI. While industry giants like Alibaba, Tencent, Baidu, and ByteDance continue to lead the charge, a new generation of AI startups – often referred to as the ā€œChinese AI Tigersā€ – is emerging as formidable players. These startups are pushing the limits of generative AI, challenging global incumbents with state-of-the-art models and breakthrough innovations. In this article, we will explore DeepSeek and five of the most influential Chinese AI startups: Moonshot AI, Zhipu AI, Baichuan AI, MiniMax, and 01.AI. Each of these companies has developed cutting-edge AI models and solutions that are shaping the future of artificial intelligence, both in China and beyond. DeepSeek: A Research-Driven AI Powerhouse in China Founded in May 2023, DeepSeek is an AI company based in Hangzhou, operating as an independent entity under High-Flyer, a leading Chinese quantitative hedge fund. Unlike many...
Read more
Marek’s Dev Diary: April 4, 2025

Marek’s Dev Diary: April 4, 2025

What is this Every Thursday, I will share a dev diary about what we’ve been working on over the past

READ MORE
Ensuring Accurate Data Annotation for AI...

Ensuring Accurate Data Annotation for AI...

A robust AI-based solution is built on data – not just any data but high-quality, accurately annotated data. Only the

READ MORE
Learning like the human mind

Learning like the human mind

The rapid advancement of artificial intelligence has led to increasingly sophisticated models, yet these systems still face fundamental efficiency challenges.

READ MORE
The Batch Normalization layer of Keras...

The Batch Normalization layer of Keras...

April 17, 2018 Vasilis Vryniotis . 31 Comments UPDATE: Unfortunately my Pull-Request to Keras that changed the behaviour of the

READ MORE
From Weeks to Days: AI-Powered Precision...

From Weeks to Days: AI-Powered Precision...

From Weeks to Days: AI-Powered Precision in Loan Automation5 min read Reading Time: 4 minutes The old-school, paper-heavy loan processing

READ MORE
Legacy Data Strategy: The AI Bottleneck

Legacy Data Strategy: The AI Bottleneck

Tech companies have been racing to integrate AI across products and processes, but many of those efforts hit walls that

READ MORE
Recipes – MetaDevo

Recipes – MetaDevo

Food recipes, that is. But cooking is kind of like programming and other computer efforts, isn’t it? Although it might

READ MORE
Future of Natural Language Processing with...

Future of Natural Language Processing with...

I recently attended a talk by Kevin Clarke (CS224n) where he talked about the future trends in NLP. I am

READ MORE
First-of-a-kind electronic skin mimics human pain...

First-of-a-kind electronic skin mimics human pain...

Ā  Electronic skins that perform the same sensory functions as human skin could mean big things for the fields of

READ MORE
An Overview of Chinese AI Tigers...

An Overview of Chinese AI Tigers...

The recent disruption caused by DeepSeek’s R1 model sent shockwaves through the AI community, demonstrating that Chinese AI advancements may

READ MORE
Previous Next