Added num_cores argument to neuron

[gaarutyunov]

What does this PR do?

Added num_cores argument to optimum-cli export neuron

Fixes # (issue)

Was getting AttributeError: 'Namespace' object has no attribute 'num_cores' on optimum-cli export neuron

Before submitting

• This PR fixes a typo or improves the docs (you can dismiss the other checks if that's the case).
• Did you make sure to update the documentation with your changes?
• Did you write any new necessary tests?

[dacorvo]

This parameter is not supported for neuron, only for neuronx.

[gaarutyunov]

This parameter is not supported for neuron, only for neuronx.

It is used here and results in an AttributeError I've mentioned in the issue.

Should I stick to export neuronx? Is export neuron still supported?

[gaarutyunov]

It is also mentioned in the docs here in the section Exporting LLMs to Neuron.

[dacorvo]

@gaarutyunov I agree this is confuzing but really this all applies to neuronx export, even if the name is neuron.

[JingyaHuang]

Hi @gaarutyunov, are you using inf1 instances? The export of LLMs is not supported by inferentia 1, you might want to use inferentia 2 instances as an alternative.

[gaarutyunov]

Hi @gaarutyunov, are you using inf1 instances? The export of LLMs is not supported by inferentia 1, you might want to use inferentia 2 instances as an alternative.

Ok, thank you for clarifying this, it wasn't clear from the documentation. I will try inf2.