Tech Spaghetti

Latest Posts

Designing AI Infrastructure for the Modern Enterprise

Enterprises are increasingly prioritising AI infrastructure, particularly generative AI, as essential for integrating AI frameworks into business workflows. The demand for specialised infrastructure is driven by the need for scalability, cost efficiency, and reliability, especially… Read more
Avoiding Data Quality Failures: Enterprise Challenges and Best Practices

Data quality is crucial for businesses, as poor data quality can lead to significant financial losses and hinder decision-making. It encompasses dimensions such as accuracy, completeness, uniqueness, consistency, timeliness, and validity. Enterprises often struggle with… Read more
Building Enterprise Data Lineage & Provenance

Data lineage is crucial for data management and governance, tracking data from its origin to destination. It ensures quality control and compliance, benefiting data engineers and owners. Unlike data provenance, which focuses on the origin… Read more

Archive Posts

Game development using Lua and Love : Y’21 January fun

January 23, 2021

Happy New Year 2021 to all my blog post readers !!! Hope you and your family are safe and healthy This being my very first blog of 2021, I would like to start this year with something fun. Over the winter holiday season of 2020/2021 (keeping myself socially distant from others and locked in my…

Game Development, Programming
Hive Custom UDFs – XML Parser (Plugin Introduction)

October 4, 2020

Hive Custom UDF Project Introduction This blog introduces a new plugin release – XMLParser as a part of the Hive Custom UDF Project. The details of this plugin is given below. Description XMLParser is the custom user defined function that would parse a xml data. A xml is a markup language and one of the…

Apache Hive, Apache Impala, Big Data, Data & Analytics, Database, Java, Plugins, Programming
Hive Custom UDFs – Project Introduction

August 29, 2020

Apache Hive is a big data database that facilitates reading, writing, and managing large datasets residing in the distributed storage and queried using SQL syntax. Built on top of Apache Hadoop, hive enables easy access to data via SQL, thus enabling data warehousing tasks such as extract/transform/load (ETL), reporting, and data analysis. Project concept Apache Hive supports…

Apache Hive, Apache Impala, Big Data, Data & Analytics, Database, Java, Plugins, Programming
Topic Modelling : Latent Dirichlet Allocation, an introduction

June 11, 2020

Imagine finding meaning out of a news content which you haven’t seen before. Topic Modelling is a type of statistical modelling that solves the purpose of finding abstract topics from a corpus of documents. Topic modelling provides methods for searching, organising and summarising large volumes of data. This modelling technique is primarily used in cases…

AI & ML, NLP, Programming, Python
IaC – Terraform: Provisioning AWS

May 13, 2020

The piece details the steps of using Infrastructure as a Code (IaC) provider, Terraform, to provision and manage Amazon Web Services (AWS) EC2 instances. The process involves installing Terraform, setting up AWS and Terraform users, writing Terraform code, initialising Terraform, and applying and removing configurations.

AWS, Cloud

A Tech Spaghetti Blog Newsletter made just for you

Latest blog posts and insights on data, analytics, cloud, pentaho, artificial intelligence and more straight to your inbox.

Subscribe

Join hundreds of happy subscribers!