ACID Delta Table

Setup shell

bin/spark-shell --packages io.delta:delta-core_2.12:1.1.0 --conf "spark.sql.extensions=io.delta.sql.DeltaSparkSessionExtension" --conf "spark.sql.catalog.spark_catalog=org.apache.spark.sql.delta.catalog.DeltaCatalog"

Retrieve Delta table history

import io.delta.tables._

val deltaTable = DeltaTable.forPath(spark, pathToTable)

val fullHistoryDF = deltaTable.history()    // get the full history of the table

val lastOperationDF = deltaTable.history(1) // get the last operation
scala> fullHistoryDF.

How to add a git repository to a composer.json file in Drupal 9

  1. Fork a Github module like https://github.com/protitude/module_markdown and change the composer.json like
@@ -1,5 +1,5 @@
-  "name": "protitude/markdown",
+  "name": "asanchez75/markdown",
  "description": "Allows content to be submitted using Markdown, a simple plain-text syntax that is transformed into valid HTML.",
  "type": "drupal-module",
  "homepage": "https://www.drupal.org/project/markdown",
  1. in the composer.json file of your Drupal 9 installation