Move Standard.Image out of distribution #14553

Akirathan · 2026-01-01T15:08:35Z

Closes #14469

Pull Request Description

Move Standard.Image out of the distribution, as an external library that will be hosted on GH as an artifact.

Important Notes

How to publish a library described at 2873e4d
Testing locally: described at Move Standard.Image out of distribution #14553 (comment)
Standard.Image build was modified such that it contains all the native libraries for all platforms. See Move Standard.Image out of distribution #14553 (comment).
For every library, that is about to be uploaded, it is ensured that main.tgz source archive is created - e11deb3
NI config had to be tweaked - --enable-urls-protocols=jar,https has been added. This caused some issues with class loading that has been fixed by a hack. See Move Standard.Image out of distribution #14553 (comment)
When running a release process, it is ensured that all the copies of Standard.Image are deleted from the release artifacts.
- In other words, when looking into the Assets on a release page, std_image_repo.zip is the only asset containing Standard.Image library.
- See Move Standard.Image out of distribution #14553 (comment)
- Done by b24f35e
Remove references to Standard.Image from Standard.Examples in ec3f261.

Remaining problems

Suggestions for Standard.Image does not work after the library has been downloaded. See Move Standard.Image out of distribution #14553 (comment)
Image visualization does not work. See Move Standard.Image out of distribution #14553 (comment)

Checklist

Please ensure that the following checklist has been satisfied before submitting the PR:

The documentation has been updated, if necessary.
Screenshots/screencasts have been attached, if there are any visual changes. For interactive or animated visual changes, a screencast is preferred.
All code follows the
Scala,
Java,
TypeScript,
and
Rust
style guides. In case you are using a language not listed above, follow the Rust style guide.
Unit tests have been written where possible.
If meaningful changes were made to logic or tests affecting Enso Cloud integration in the libraries,
or the Snowflake database integration, a run of the Extra Tests has been scheduled.
- If applicable, it is suggested to paste a link to a successful run of the Extra Tests.

There is now README.md in a namespace directory root.

Previously, was pointing to non-existing file, so the real `manifest.yaml` generated file was not cleaned.

…ace.

Akirathan · 2026-01-05T13:35:25Z

First nightly release scheduled: https://github.com/enso-org/enso/actions/runs/20717064290

GitHub
Nightly Release · enso-org/enso@6850206
Enso Analytics is a self-service data prep and analysis platform designed for data teams. - Nightly Release · 6850206

Akirathan · 2026-01-05T16:00:16Z

Choosing Standard.Image was not a good idea. It contains platform-specific native libraries in the polyglot/lib directory. Which means that there are 3 different versions of this library for three supported platforms. It is not yet clear how should this be supported in the library repository. The most straightforward solution now would be to merge all the native libraries into polyglot/lib directory, but that would require non-trivial changes to the sbt build configuration.

I realized this after the latest failure in the latest Upload backend job.

TL;DR

For the purpose of the demonstration, let's choose a library that has no native libraries.

Image library is going to be uploaded to an external repository, therefore, we need all the native libraries included.

Akirathan · 2026-01-06T12:44:35Z

After fd8bb2283b65032aa587ed18b726145cb0947d73, the contents of built-distribution/**/lib/Enso/Image is:

This is needed because we don't yet have a way how to distinguish remote Enso.Image library based on the current platform.

Akirathan · 2026-01-06T12:46:47Z

Another iteration of Nightly Release workflow at https://github.com/enso-org/enso/actions/runs/20748715350

GitHub
Nightly Release · enso-org/enso@87721f4
Enso Analytics is a self-service data prep and analysis platform designed for data teams. - Nightly Release · 87721f4

engine/runtime-language-epb/src/main/java/org/enso/interpreter/epb/HostClassLoader.java

project/DistributionPackage.scala

project/Editions.scala

project/JarExtractor.scala

project/Editions.scala

Akirathan · 2026-01-19T16:18:41Z

Suggestions work locally on ec3f261. Tested with:

sbt buildEngineDistribution
Build the library repository:

> (cd built-distribution/**/lib; zip -r repo.zip Standard/Image/**)
> ZIP=(realpath **/repo.zip)

Rewrite built-distribution/**/0.0.0-dev.yaml so that the 1std_image_repo.zip points somewhere to jar:file://$ZIP
Remove std image from distribution: rm -rf built-distribution/**/lib/Standard/Image
Ensure std image is not cached: rm -rf ~/Library/Application\ Support/org.enso/lib
Start GUI with corepack pnpm run dev:gui
Create new project.
Write from Standard.Image import all in text editor.
Try to search for Image in the component browser.
Suggestions are appearing.

engine/runtime-language-epb/src/main/java/org/enso/interpreter/epb/HostClassLoader.java

JaroslavTulach · 2026-01-20T07:00:14Z

engine/runtime-language-epb/src/main/java/org/enso/interpreter/epb/HostClassLoader.java

      } catch (Throwable e) {
-        logger.log(Logger.Level.TRACE, "Failure while loading a class: " + e.getMessage(), e);
-        throw e;
+        if (isAttemptToLoadBytecodeInNI(e)) {


What class(es) required the 355bd3d check?

org.enso.base.Text_Utils. See the failure message in #14553 (comment).

That's very weird. I believe Text_Utils should be compiled into NI. Maybe we somehow get into findClass without trying to HostClassLoader.loadClass or HostClassLoader.getParent.loadClass first... Very strange.

build.sbt

build_tools/build/src/engine/context.rs

distribution/edition.template.yaml

docs/libraries/sharing.md

isAOT can be checked via `TruffleOptions`.

JaroslavTulach · 2026-01-20T10:44:13Z

These failing tests:

❌ should provide an image file
Uncaught error: (Panic (No_Such_Method.Error Main UnresolvedSymbol<image_file>) (No_Such_Method.Error Main UnresolvedSymbol<image_file>))
❌ should provide an image
Uncaught error: (Panic (No_Such_Method.Error Main UnresolvedSymbol) (No_Such_Method.Error Main UnresolvedSymbol))
❌ should provide a matrix
Uncaught error: (Panic (No_Such_Method.Error Main UnresolvedSymbol) (No_Such_Method.Error Main UnresolvedSymbol))

should be moved to Image tests out of Examples_Tests says @jdunkerley.

hubertp · 2026-01-20T10:51:52Z

What about:

GitHub
enso/app/gui/src/project-view/components/visualizations/HistogramVisualization.vue at develop · enso-org/enso
Enso Analytics is a self-service data prep and analysis platform designed for data teams. - enso-org/enso

GitHub
enso/app/gui/src/project-view/components/visualizations/ImageBase64Visualization.vue at develop · enso-org/enso
Enso Analytics is a self-service data prep and analysis platform designed for data teams. - enso-org/enso

Akirathan · 2026-01-20T11:27:57Z

What about:

* [`develop`/app/gui/src/project-view/components/visualizations/HistogramVisualization.vue#L9](https://github.com/enso-org/enso/blob/develop/app/gui/src/project-view/components/visualizations/HistogramVisualization.vue?rgh-link-date=2026-01-20T10%3A51%3A52Z#L9)

* [`develop`/app/gui/src/project-view/components/visualizations/ImageBase64Visualization.vue#L4](https://github.com/enso-org/enso/blob/develop/app/gui/src/project-view/components/visualizations/ImageBase64Visualization.vue?rgh-link-date=2026-01-20T10%3A51%3A52Z#L4)

Good question. HistogramVisualization has been turned off some time ago. Image visualization works on develop, but does not work on this PR. According to @jdunkerley it should work even on this PR.

# Conflicts: # distribution/lib/Standard/Examples/0.0.0-dev/docs/api/Main.md

Pavel Marek added 10 commits January 1, 2026 13:50

typo

a222384

Move Image library from Standard to Enso namespace

617a466

docs for the Enso lib namespace.

15effe8

reflect stdlib namespace change in sbt build

a2bad60

createEngineDistribution does not copy regular files.

467a5ad

There is now README.md in a namespace directory root.

Deduplicate Editions.writeEditionConfig sbt task

ea44b7b

Fix cleanFiles for editions project.

610164b

Previously, was pointing to non-existing file, so the real `manifest.yaml` generated file was not cleaned.

Generate correct editions yaml file - Image is not in Standard namesp…

a5abad0

…ace.

fix imports in Image_Tests

61661e5

fix service registration in Image/package.yaml

96bb729

Akirathan self-assigned this Jan 1, 2026

Akirathan added CI: No changelog needed Do not require a changelog entry for this PR. CI: Clean build required CI runners will be cleaned before and after this PR is built. labels Jan 1, 2026

Pavel Marek added 4 commits January 2, 2026 14:21

Enso.Image has the same version as standard libraries

949bd00

Do not verrify Image generated package

237fec5

Update NativeLibraryFinderTest

b24a7e9

Fix Image name in another Enso test

344c54a

enso-bot bot mentioned this pull request Jan 2, 2026

Change release process to upload custom edition #14469

Closed

[rust build script] Upload extension libs as asset to the release

6850206

do not assets url path

b0ef670

Pavel Marek added 3 commits January 5, 2026 17:02

Upload extension-libs.zip only once.

06e526f

opencv-wrapper does not discard native libs from other platforms.

fd8bb22

Image library is going to be uploaded to an external repository, therefore, we need all the native libraries included.

fmt

87721f4

Pavel Marek added 3 commits January 9, 2026 11:37

Move Enso.Image back to Standard namespace

88635e7

Refactor Enso.Image to Standard.Image usages

32b376e

Use template for edition config

295ad89

Akirathan requested review from AdRiley, GregoryTravis, hubertp and jdunkerley as code owners January 19, 2026 11:36

hubertp reviewed Jan 19, 2026

View reviewed changes

Remove references to Standard.Image from Standard.Examples

ec3f261

JaroslavTulach approved these changes Jan 20, 2026

View reviewed changes

Pavel Marek added 8 commits January 20, 2026 10:53

Remove dependency on org.graalvm.nativeimage.

174cb32

isAOT can be checked via `TruffleOptions`.

matchArch is argument to JarExtractor

65595d0

Guard against null error message

9a99c00

refact: use underscore in sbt import

7beb719

refact: do not use double negation

48ee69f

typo in docs

99de73b

typo in docs

eb0dd53

update docs - ensoup

d08e428

Akirathan force-pushed the wip/akirathan/release-lib branch from 97f2eb1 to d08e428 Compare January 20, 2026 10:38

Remove non-existing examples from Example_Tests

b833034

enso-bot bot mentioned this pull request Jan 21, 2026

Storing LocalDate in off-heap IntBuffer #14652

Merged

2 tasks

Pavel Marek added 4 commits January 21, 2026 10:22

Update Examples API

3fe7ff0

Ignore edition.template.yaml by prettier

ed39883

Add edition.template.yaml as source to bazel sbt build

015967d

Merge branch 'develop' into wip/akirathan/release-lib

efbb670

# Conflicts: # distribution/lib/Standard/Examples/0.0.0-dev/docs/api/Main.md

jdunkerley approved these changes Jan 21, 2026

View reviewed changes

Akirathan merged commit 0cfb49f into develop Jan 21, 2026
89 of 91 checks passed

Akirathan deleted the wip/akirathan/release-lib branch January 21, 2026 13:58

Akirathan mentioned this pull request Jan 22, 2026

Broken suggestions loading after library is downloaded #14672

Open

Move Standard.Image out of distribution #14553

Move Standard.Image out of distribution #14553

Uh oh!

Conversation

Akirathan commented Jan 1, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Pull Request Description

Important Notes

Remaining problems

Checklist

Uh oh!

Akirathan commented Jan 5, 2026 • edited by unfurl-links bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Akirathan commented Jan 5, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

TL;DR

Uh oh!

Akirathan commented Jan 6, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Akirathan commented Jan 6, 2026 • edited by unfurl-links bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Akirathan commented Jan 19, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Uh oh!

Uh oh!

JaroslavTulach Jan 20, 2026

Choose a reason for hiding this comment

Uh oh!

Akirathan Jan 20, 2026

Choose a reason for hiding this comment

Uh oh!

JaroslavTulach Jan 20, 2026

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

JaroslavTulach commented Jan 20, 2026

Uh oh!

hubertp commented Jan 20, 2026 • edited by unfurl-links bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Akirathan commented Jan 20, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

5 participants

Akirathan commented Jan 1, 2026 •

edited

Loading

Akirathan commented Jan 5, 2026 •

edited by unfurl-links bot

Loading

Akirathan commented Jan 5, 2026 •

edited

Loading

Akirathan commented Jan 6, 2026 •

edited

Loading

Akirathan commented Jan 6, 2026 •

edited by unfurl-links bot

Loading

Akirathan commented Jan 19, 2026 •

edited

Loading

hubertp commented Jan 20, 2026 •

edited by unfurl-links bot

Loading

Akirathan commented Jan 20, 2026 •

edited

Loading