Notes is your knowledge-base management platform where you can curate, take notes, and summarize information from the Internet. Click here to learn more and here to learn how to use.

Data Collection, Web Scraping, Data Engineering and Cloud Technology Related News and Tutorials

timeline

Published Dec 21 '21. Last edited Aug 08 '25

Topic #datacollection #datapipelines #dataengineers #webscraping #webcrawling #dataengineering

This topic collects tutorials related to collecting data #DataCollection, #DataEngineering and troubleshooting / building data pipelines #DataPipelines for #DataEngineers, including #WebScraping and #WebCrawling techniques.

add a comment

24 notes, 8 links

prev 1 2 3 next

Aug 01 '24
Fact

aiOla drops ultra-fast ‘multi-head’ speech recognition model, beats OpenAI Whisper | VentureBeat
Today, Israeli AI startup aiOla announced the launch of a new, open-source speech recognition model that is 50% faster than OpenAI’s famous Whisper.

full text available (5272 bytes), visible to author user after login.

add a comment
Jul 24 '24
Tutorial

Cheat sheet: Converting Spark SQL to AWS Athena SQL
For Data Engineers trying to debug #spark data pipelines using #AWS #Athena which is based on open sourced Presto technology, the little check list below will very likely save 30 minutes to one ...

add a comment
Jul 02 '24
Tutorial

How to transcribe YouTube Videos with no Transcripts
YouTube is a vast collection of videos of all types, a lot of them do not have transcripts unfortunately. Here is how I found out a method to automate the task of easily obtaining transcripts o...

add a comment
May 31 '24
Fact

FineWeb: decanting the web for the finest text data at scale - a Hugging Face Space by HuggingFaceFW
official #HuggingFace blog post for #FineWeb, dataset for #LLM pretraining.

full text available (52126 bytes), visible to author user after login.

add a comment
Apr 22 '24
Fact

Saga of Setting Up DataSync to Transfer Data from AWS S3 to Azure
This is a process of an engineer using about 5 months to complete the setup.

full text available (21469 bytes), visible to author user after login.

add a comment
Dec 29 '23
Fact

Zendesk Moves from DynamoDB to MySQL and S3 to Save over 80% in Costs
Zendesk replaced #DynamoDB with #MySQL as their database solution and saved 80% of cost

full text available (3437 bytes), visible to author user after login.

add a comment
Dec 11 '23
Fact

AI firm Anthropic slashed its AWS bill 40% using Karpenter
AI company Anthropic slashed its AWS bill by 40% using an open source tool that AWS itself gifted to the community called Karpenter.

add a comment
Oct 10 '23
Uncaterized

Data engineering at Meta: High-Level Overview of the internal tech stack

private note (367 bytes) available, visible to author user or users who paid for it after login.

full text available (16668 bytes), visible to author user after login.

add a comment
Sep 14 '23
Fact

英伟达最新投资了一家“最有潜力IPO的AI公司”：Databricks
Databricks vs #SNOW Databricks received investment from #NVDA and #COF, its revenue for full year 2023 is expected to be above $1.5B, 50% higher than 2022, while #SNOW TTM (trailing-twelve-month...

保存了原文（2810字节），作者用户登录后可见。

add a comment
Aug 02 '23
Uncaterized

Try Spellbook today to create your first apps! | Scale

private note (754 bytes) available, visible to author user or users who paid for it after login.

full text available (2185 bytes), visible to author user after login.

add a comment

Terms of Use: You are in agreement with our Terms of Services and Privacy Policy. If you have any question or concern to any information published on SaveNowClub, please feel free to write to us at savenowclub@gmail.com