[all] Support for M1 builds

[mantissaman]

While trying to run OSO Python sample app or trying to install oso (pip install oso) on Apple M1 architecture I am getting following error:
(venv) ➜ oso-python-quickstart git:(main) pip install -r requirements.txt
ERROR: Could not find a version that satisfies the requirement oso
ERROR: No matching distribution found for oso

[saolsen]

Yeah sorry we don't have M1 builds yet. The easiest thing to do is use x64 python via rosetta for development. We hope to have M1 builds available soon.

[delicb]

@mantissaman
I did manage to make it work locally with Python 3.9 on M1 chip, with the following steps.

1. install Rust - brew install rust - needed for compile
2. create virtual env - python -m venv <path-to-your-env>
3. activate virtual env - source <path-to-your-env>/bin/activate
4. install wheel (not sure if required, but some errors have gone after I did this) - pip install wheel
5. clone oso repo - git clone https://github.com/osohq/oso.git
6. build - cd oso && make python-build

The last step builds OSO locally and installs it in the active python environment by creating <path-to-your-env>/site-packages/oso.egg-link.

After that, I was able to import and use OSO. Note that I needed OSO only, not flask or sqlalchemy libs, but you should be able to install those manually once you have OSO core installed.

oso ❯ python
Python 3.9.2 (default, Mar  5 2021, 18:57:15)
[Clang 12.0.0 (clang-1200.0.32.29)] on darwin
Type "help", "copyright", "credits" or "license" for more information.
>>> import platform
>>> platform.processor()
'arm'
>>> import oso
>>> o = oso.Oso()
>>> o.load_str('allow("foo", "bar", "baz");')
>>> o.is_allowed("foo", "bar", "baz")
True
>>>

I hope this helps.

[mantissaman]

@delicb - Many thanks. It worked like a charm.

[rcrowe]

Unable to develop with Go; either the linker fails or if I try forcing the architecture I see...

> env GOOS=darwin GOARCH=amd64 go build .
package oso-test
	imports github.com/osohq/go-oso
	imports github.com/osohq/go-oso/internal/ffi: build constraints exclude all Go files in $GOPATH/pkg/mod/github.com/osohq/go-oso@v0.14.0/internal/ffi

[saolsen]

Hey @rcrowe. We aren't set up to build arm64 yet but you can build it yourself with a couple extra steps.

1. Clone the oso repo and build the library for arm64. cargo build --release
2. Clone the go-oso repo and replace the library in internal/ffi/native/macos/libpolar.a With the one you just built (found in target/release/libpolar.a)
3. Replace the line in the go-oso library in internal/ffi/ffi.go that says

// #cgo darwin,amd64 LDFLAGS: ${SRCDIR}/native/macos/libpolar.a -ldl -lm

With

// #cgo darwin,arm64 LDFLAGS: ${SRCDIR}/native/macos/libpolar.a -ldl -lm

[rcrowe]

Thanks @saolsen that worked locally 🙇🏻

What would need to happen in order to support this within the various languages?

• Under macos_libs run rustup target add x86_64-apple-darwin & cargo build --target aarch64-apple-darwin --release
• Copy libpolar.a with the target in the filename, into each language
• For go, add a new cgo directive
  ??

[saolsen]

We are planning to include builds for arm in the official release, we just haven't gotten to it yet. The way you would have to build it yourself is a little bit different for every language.

[asyncee]

Leaving a comment to indicate demand on this feature. Currently we have to support two separate paths to deploy a project :)

[gj]

We might be able to take some inspiration from rust-lang/rust#75991.

[taybenlor]

Is there a planned release date for a version with ARM wheels?

[saolsen]

We're planning to include a macOS ARM wheel for our python library in our release next week. Other languages will be a bit later but hopefully not too much longer.

[taybenlor]

Awesome! Thanks. Will that include Linux ARM as well? I’m using the Python library inside docker on an M1.