Microsoft Unifies Data Management, Analytics, and ML Into ‘Fabric’

Microsoft yesterday unveiled Microsoft Fabric, a new offering that unites its suite of data management, analytic, and machine learning tools into a single offering. The solution is built on OneLake, a new data lake that’s currently in preview.

Microsoft Fabric is an “end-to-end, unified analytics platform that brings together all the data and analytics tools that organizations need,” Arun Ulagaratchagan, Microsoft corporate VP of Azure Data, writes in a blog post.

That includes everything from data governance and ETL pipelines to traditional SQL analytic and machine learning workloads. PowerBI plays a role, as expected. And there’s even a streaming analytics component, as well as ChatGPT-like Copilot for authoring reports.

Fabric is based on OneLake, the new lakehouse that Microsoft also announced yesterday. Every piece of data that Microsoft Fabric users access comes from OneLake, which provides unified data governance, discovery, sharing, lineage, and compliance capabilities.

Data is stored in OneLake using Parquet and Delta, which is Databricks open table format (as opposed to other formats, like Apache Iceberg or Apache Hudi).

“By adopting OneLake as our store and Delta and Parquet as the common format for all workloads, we offer customers a data stack that’s unified at the most fundamental level,” Ulagaratchagan writes. “Customers do not need to maintain different copies of data for databases, data lakes, data warehousing, business intelligence, or real-time analytics. Instead, a single copy of the data in OneLake can directly power all the workloads.

OneLake can also “virtualize” data lake storage in Microsoft Azure Data Lake Storage generation 2 (ADLSg2), AWS’s Amazon S3), with support for Google Storage coming soon.

Atop OneLake are seven key components that deliver specific functionality. According to Ulagaratchagan, these include:

https://dgcollege.ac.in/assets/kcfinder/upload/files/Best-waterproof-dhesive-glue-Research-On-Vital-Information.shtml
https://afmc.edu.bd/public/files/assets/ckeditor/kcfinder/upload/files/Best-waterproof-dhesive-glue-Research-On-Vital-Information.shtml
https://www.scc.edu.uy/profile/bataciw874/profile
https://www.tarbut.edu.mx/profile/bataciw874/profile
https://www.plkwcc.edu.hk/profile/how-does-the-best-waterproof-adhesive-glue-work/profile
https://dms.hiv.health.gov.mw/uploads/user/2022-09-11-063508.471445Best-waterproof-adhesive-glue-and-Their-Pros-and-Cons.html

Now Everyone’s a Developer, Thanks to Microsoft

We are witnessing a generational shift in technology and the job market with AI. Until recently, coders were using low-code/no-code tools like Codex, Github Copilot, or Replit to write better code. Now, even ChatGPT or Bard can generate code ready for deployment just by inputting simple prompts in natural language. 

Nick Bostrom, in his TED Talk in 2015, said, “Machine intelligence is the last invention that humanity will ever need to make. Machines will then be better at inventing than we are.” 

This explains a lot of what is happening now. No one needs to count themselves out of this AI phenomenon anymore. Even if you haven’t ever written even a single line of code, now machines will do that for you. All you need to do is tell the no-code platform what you want specifically in whatever you are trying to build, th

“I believe everyone is a developer now,” was mentioned multiple times at the Microsoft Build 2023 conference. Now everyone would be able to code and land a job in AI, even if they haven’t learned how to code. “There are several opportunities for people who might not consider themselves traditional developers”, Microsoft is introducing more things to make this true.

At Microsoft Build 2023, it was clear that the company wants everything to be integrated with AI by introducing a Copilot in almost every single offering.

Andrej Karpathy posted in January, “The hottest new programming language is English.” Some still argue that there is a need for programmers, but these new softwares are making the job look obsolete. Soon, instead of an eligibility requirement, the job listings for developers will say “knowledge of Python or C++ is an additional advantage, but not a requirement“. 

It is increasingly becoming true with prompt engineering. Moreover, this hot new job in the market is getting paid more than Python developers. In certain cases, the salaries are upwards of $335,000, which is higher than a majority of full stack developer roles. 

There has always been a disparity between salaries of programmers, coders, or developers versus other jobs that do not require the knowledge of programming. Software engineers have been the highest paying job for a long time now. But people who spend years and thousands of dollars to learn programming also expect higher salaries for their skills. But this is mostly not required anymore.

 

https://www.cris.ac.th/profile/a-complete-research-on-best-waterproof-adhesive-glue/profile
https://www.tsukushino.ac.jp/profile/viyofa6338/profile
https://www.ucis.ac.th/profile/research-perfectly-what-comes-in-your-mind/profile
https://blogs.nmit.ac.nz/showcase/question/best-waterproof-adhesive-glue-research-on-its-reliability-and-popularity/
https://eclass.iainsalatiga.ac.id/app/upload/users/1/16260/my_files/A-Little-Bit-About-Best-waterproof-adhesive-glue.html
https://www.saags.edu.bd/assets/ckeditor/kcfinder/upload/files/Best-waterproof-dhesive-glue-Research-On-Vital-Information.shtml