【Azure Data Factory】第一篇入门

大数据菜鸟教程

已于 2023-04-24 11:30:18 修改

阅读量1.7k

点赞数

文章标签： azure

于 2023-04-23 22:48:14 首次发布

本文链接：https://blog.csdn.net/qq_41855232/article/details/130332382

版权

本文介绍了Azure存储平台的数据服务，如Blobs、文件、Elastic SAN、队列和表，强调了Data Lake Storage Gen2在大数据分析中的作用。还详细讨论了安全访问存储账户的方式，包括Azure AD集成、SAS授权等。此外，文章涉及了Azure Databricks和Spark的使用，展示如何创建容器、挂载数据以及执行数据探索和分析。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

https://learn.microsoft.com/en-us/azure/storage/blobs/data-lake-storage-introduction
https://learn.microsoft.com/en-us/azure/data-factory/
https://learn.microsoft.com/en-us/azure/synapse-analytics/

https://learn.microsoft.com/en-us/azure/synapse-analytics/
https://learn.microsoft.com/en-us/azure/synapse-analytics/overview-what-is
https://learn.microsoft.com/en-us/azure/synapse-analytics/get-started
https://learn.microsoft.com/en-us/azure/synapse-analytics/machine-learning/what-is-machine-learning

win 环境变量
person-Path
;%HADOOP_HOME%\bin;
%JAVA_HOME%\bin;
%JAVA_HOME%\jre\bin;
%MAVEN_HOME%\bin;
D:\JAVA\SSH Secure Shell;
%USERPROFILE%.dotnet\tools

person-ClassPath
.;%JAVA_HOME%\lib\dt.jar;
%JAVA_HOME%\lib\tools.jar;

all-ClassPath
.;%JAVA_HOME%\lib\dt.jar;
%JAVA_HOME%\lib\tools.jar;

all-Path
D:\JAVA\spark-2.4.6-bin-hadoop2.6\bin;
%SYSTEMROOT%\System32\WindowsPowerShell\v1.0\;
%SystemRoot%\System32\Wbem;%SystemRoot%;
%SystemRoot%\system32;%HADOOP_HOME%\bin;
%JAVA_HOME%\bin;%JAVA_HOME%\jre\bin;
%MAVEN_HOME%\bin;
C:\Python27\;
C:\Python27\Scripts;
%CommonProgramFiles%\Microsoft Shared\Windows Live;
C:\Program Files (x86)\NVIDIA Corporation\PhysX\Common;
C:\Windows\System32\Wbem;C:\Program Files\Intel\WiFi\bin\;
C:\Program Files\Common Files\Intel\WirelessCommon\;
D:\MySQL Server 5.0\bin;C:\Windows\System32;
D:\JAVA\oracle-tools\instantclient_12_1;
D:\JAVA\Scala\bin;
D:\MicrosoftVSCode\bin;
D:\mingw64\bin;C:\Program Files\dotnet\