[Documentation]: Update for 1.0 Release

See original GitHub issue

As we gear up towards our 1.0 release, documentation needs to be added about the following:

New docs:

How to’s

Connecting to Remote Storage from your Local Machine
- Connect to ADLS gen2 account locally (#337) - PR link
- Connect to Azure Blobs (WASB) account locally (#337) - PR link
Connecting to Data Sources
- SQL Server - PR link
- EventHub - PR link
- MongoDB - PR link
Use .NET for Apache Spark locally using Jupyter notebooks (#529) - PR link
Use .NET for Apache Spark locally using VS Code - PR link
User-defined Functions in .NET for Apache Spark
- Invoking Scala/Java User-defined Functions from Spark apps written in C# - PR link
- Invoking C# User-defined Functions from Spark apps written in Scale/Java/Python (import this) - PR link
Using .NET for Spark on Azure Synapse Analytics - Update links after how to guides published
- Using .NET Notebooks (including where to find documentation pertaining to .NET Interactive) - PR link
  - Installing Nuget Packages in Notebooks - PR link

Dotnet-interactive guide/good to know’s

Dotnet interactive serialization issue (#619) - PR link
Running UDFs in notebooks - PR link

Migration guide - #721

Document moving Microsoft.Spark.Experimental to Microsoft.Spark. - #691
Known issues: e.g.) grouped map UDF for Spark 3.0
.NET Delta/Hyperspace version | OSS Delta/Hyperspace version | Spark versions matrix
Dropping support for .NET Framework
Show Scala version in microsoft-spark*.jar filename

Existing docs

Update this documentation to reflect how to zip binaries for .NET for Spark batch submission. - PR link
Update FAQs to include how ArrayList and HashTable cannot be supported as UDF return type #684 - PR link - Update links after how to guides published
Verify (and simplify) this - PR link
Update this for Submitting batch jobs (with additional dependencies) - PR link
Verify all public facing documentation
- GitHub documentation
- .NET Website (https://dot.net/spark) - PR link
- Azure Synapse Analytics - PR link - Update links after how to guides published

Issue Analytics

State:
Created 3 years ago
Reactions:1
Comments:12 (7 by maintainers)

Top GitHub Comments

1reaction

Niharikaduttacommented, Dec 11, 2020

@Niharikadutta Do you think we can close this issue?

Yes we can close this.

1reaction

imback82commented, Oct 4, 2020

Can we also capture dropping support for .NET Framework?

Top Results From Across the Web

Question - [1.0.0-exp.8] Is the documentation updated?

Just trying to figure out the updates, without using the release announcement forum post as the only source of information.

Release Highlights for scikit-learn 1.0

This release includes many documentation improvements. Out of over 2100 merged pull requests, about 800 of them are improvements to our documentation. Total ......

App Store Connect API 1.0 release notes

Update your server-side code to use new features, and test your code against API changes. App Store Connect API 2.3 release notes. Update...

SQL Release 1.0 release notes

1.0.5 - December 5th, 2014. Features. SQL Release will now apply changes in static data when creating an update from a package or...

1.0 Release Notes Red Hat Software Collections 1

The Red Hat Software Collections 1.0 Release Notes document the major features and contains important information about known problems in Red Hat Software ......