This is a hands on post where I show how to create a SFTP server in AWS using the S3 Transfer Family service. For security, the SFTP server only allows connections from a list of IPs and users in the SFTP server only have access to a limited number of…

In this post I sketch the architecture of a recommender in AWS. Recently, AWS has released a Recommender service that should in principle handles the whole infrastructure of such an application. However, building it “from scratch” is way more interesting since it requires hooking quite a lot of different AWS…

Trying Delta Lake in production might reserve you quite a few surprises.

I have seen several posts and tutorials on Delta Lake using “Hello World” kind of examples, where everything works wonderfully. However, as most of you know, the performance of data processing technologies changes drastically as the amount of data that it handles increases. That’s why I decided to evaluate Delta…

Danilo S Brambila

Data Engineer, father, retired physicist.

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store