![]() This release includes Java/Scala artifacts in Maven Central, and Python artifacts in PyPi and Conda Forge. VEP schema changes fixes a bug with indel parsing Nightly notebook tests are now dockerized, making it easier to integrate Glow with other bioinformatics libraries. Glow incorporates new functionality for sample masking in GWAS v1.1.1, which has been documented as a quickstart guide. ![]() and made their first contributions in #501.Thanks to Alex Barreto, Jasser Abidi, Cameron Smith, Marcus Henry, Karen Feng, Joseph Bradley, and William Brandler for their contributions to this release New Contributors However, we moved forward with the new release as it is unclear when Dataproc or EMR will support Spark 3.2 So for now we expect the Spark 3 circleci tests to continue failing until we can resolve the hail tests. The Spark 3 ci/cd tests depend on Hail, and these were failing since Hail does not yet support Spark 3.2, they are waiting on Google's Dataproc and AWS EMR to upgrade from Spark 3.1. Glow version 1.1.2 is the last release that supports Spark 2 So we are removing support for Spark 2, including the Spark 2 continuous integration tests (ci/cd) performed with circleci. Databricks, AWS EMR and Google Dataproc now depend on Hadoop 3.x, which is incompatible with Spark 2. We wrote a Shim to maintain backwards compatibility. Glow leverages private catalyst APIs that have changed from Spark 3.1 to Spark 3.2. The Glow notebook continous integration test now uses Databricks Runtime 10.4, which is on Spark 3.2.1 ( workflow definition json) Docker containers projectglow/open-source-glow:1.2.1, projectglow/databricks-glow:1.2.1, projectglow/databricks-glow:10.4 and projectglow/databricks-hail:0.2.93 can be found in projectglow's dockerhub. This release includes Java/Scala artifacts in Maven Central, and Python artifacts in pypi.
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |