Python on Snowflake: 1 Million Record Migration from SQL Server using read_sql and write_pandas

Sean MacKenzie Data Engineering
Sean MacKenzie Data Engineering
5.8 هزار بار بازدید - 3 سال پیش - Python on Snowflake: 1 Million
Python on Snowflake: 1 Million Record Migration from SQL Server using read_sql and write_pandas

Migrating data across data platforms can be a challenge. Luckily, Pandas, Snowflake and the Snowflake Connector for Python can make this process pretty easy.  In this episode, we’re going to migrate one million records from SQL Server to Snowflake.  To do this, we’ll use pyodbc, pandas, and the snowflake connector, as well as pandas_tools from the extended connector.  Armed with these tools, we’ll be able to make our migration easy and repeatable.

Related Videos:
Python on Snowflake: 1 Million Record Migration from SQL Server using read_sql and write_pandas
You are watching this one now!
Python on Snowflake - How to use execute_async to kick off one/more queries - No stopping the code!
Python on Snowflake - How to use exec...
How to Use SQL Joins when Using Python on Snowflake to Get Pandas Dataframes
How to Use SQL Joins when Using Pytho...
How to Use Python to Create Stored Procedures in Snowflake - SQL, Javascript, and Python Example
How to Use Python to Create Stored Pr...
Python on Snowflake - How to Perform Transactions with Rollback
Python on Snowflake - How to Perform ...
Python on Snowflake - How to Perform Concurrent Select Queries Using execute_async
Python on Snowflake - How to Perform ...
Python on Snowflake - How to Use Describe()
Python on Snowflake - How to Use Desc...
Python on Snowflake: How to use Merge (Upsert)
Python on Snowflake: How to use Merge...
Python on Snowflake - How to Read and Write JSON Data Part 1
Python on Snowflake - How to Read and...


Want to get access to premium content made just for you and have a chat with me? Find me on Patreon :  
Patreon: mackenziedata..

Want to work with me 1:1? Contact me today  and book your free 20 min consultation!
Contact form you can find at http://www.mackenziemackenzie.com/

Follow me on social media:
Facebook: mackenziedat..
Twitter: seamacke
Instagram: seamacke
Reddit: seamacke
LinkedIn: psmackenzie

Get Microsoft Office including Access:
https://click.linksynergy.com/fs-bin/...

Got a YouTube Channel? I use TubeBuddy, it is awesome. Give it a try:
https://www.tubebuddy.com/seanmackenz...


For developers looking for a new role, check out:
https://www.toptal.com/qKaO2b/worlds-...

Needing to hire technical resources for your project? Get the best:
https://www.toptal.com/qKaO2b/worlds-...

#Snowflake #SQLServer #DataEngineering

Python on Snowflake: 1 Million Record...
3 سال پیش در تاریخ 1400/05/22 منتشر شده است.
5,857 بـار بازدید شده
... بیشتر