Skip to content

Commit

Permalink
Deployment of commit a163cf9 [ci skip]
Browse files Browse the repository at this point in the history
  • Loading branch information
Unknown committed Jan 7, 2025
1 parent 40bcf5a commit f5cc943
Show file tree
Hide file tree
Showing 114 changed files with 2,381 additions and 2,498 deletions.
2 changes: 1 addition & 1 deletion apiv2/contributing/tests/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -5426,7 +5426,7 @@ <h2 id="overhead-from-fixtures">Overhead from Fixtures<a class="headerlink" href
<span class="normal"><a href="#__codelineno-0-9"> 9</a></span>
<span class="normal"><a href="#__codelineno-0-10">10</a></span>
<span class="normal"><a href="#__codelineno-0-11">11</a></span></pre></div></td><td class="code"><div><pre><span></span><code><a id="__codelineno-0-1" name="__codelineno-0-1"></a><span class="nd">@pytest</span><span class="o">.</span><span class="n">mark</span><span class="o">.</span><span class="n">parametrize</span><span class="p">(</span><span class="s1">&#39;execution_number&#39;</span><span class="p">,</span> <span class="nb">range</span><span class="p">(</span><span class="mi">5000</span><span class="p">))</span>
<a id="__codelineno-0-2" name="__codelineno-0-2"></a><span class="k">def</span> <span class="nf">test_private_dataset_owner_access</span><span class="p">(</span>
<a id="__codelineno-0-2" name="__codelineno-0-2"></a><span class="k">def</span><span class="w"> </span><span class="nf">test_private_dataset_owner_access</span><span class="p">(</span>
<a id="__codelineno-0-3" name="__codelineno-0-3"></a> <span class="n">execution_number</span><span class="p">,</span>
<a id="__codelineno-0-4" name="__codelineno-0-4"></a> <span class="n">expdb_test</span><span class="p">:</span> <span class="n">Connection</span><span class="p">,</span>
<a id="__codelineno-0-5" name="__codelineno-0-5"></a> <span class="n">user_test</span><span class="p">:</span> <span class="n">Connection</span><span class="p">,</span>
Expand Down
18 changes: 9 additions & 9 deletions benchmark/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -5533,7 +5533,7 @@ <h3 id="listing-the-benchmark-suites">Listing the benchmark suites<a class="head
<span class="normal"><a href="#__codelineno-0-3">3</a></span>
<span class="normal"><a href="#__codelineno-0-4">4</a></span>
<span class="normal"><a href="#__codelineno-0-5">5</a></span>
<span class="normal"><a href="#__codelineno-0-6">6</a></span></pre></div></td><td class="code"><div><pre><span></span><code><a id="__codelineno-0-1" name="__codelineno-0-1"></a><span class="kn">import</span> <span class="nn">openml</span>
<span class="normal"><a href="#__codelineno-0-6">6</a></span></pre></div></td><td class="code"><div><pre><span></span><code><a id="__codelineno-0-1" name="__codelineno-0-1"></a><span class="kn">import</span><span class="w"> </span><span class="nn">openml</span>
<a id="__codelineno-0-2" name="__codelineno-0-2"></a>
<a id="__codelineno-0-3" name="__codelineno-0-3"></a><span class="c1"># using the main entity type task, only benchmark suites are returned</span>
<a id="__codelineno-0-4" name="__codelineno-0-4"></a><span class="c1"># each benchmark suite has an ID, some also have an alias. These can be</span>
Expand Down Expand Up @@ -5582,7 +5582,7 @@ <h3 id="fetching-details">Fetching details<a class="headerlink" href="#fetching-
<span class="normal"><a href="#__codelineno-3-4">4</a></span>
<span class="normal"><a href="#__codelineno-3-5">5</a></span>
<span class="normal"><a href="#__codelineno-3-6">6</a></span>
<span class="normal"><a href="#__codelineno-3-7">7</a></span></pre></div></td><td class="code"><div><pre><span></span><code><a id="__codelineno-3-1" name="__codelineno-3-1"></a><span class="kn">import</span> <span class="nn">openml</span>
<span class="normal"><a href="#__codelineno-3-7">7</a></span></pre></div></td><td class="code"><div><pre><span></span><code><a id="__codelineno-3-1" name="__codelineno-3-1"></a><span class="kn">import</span><span class="w"> </span><span class="nn">openml</span>
<a id="__codelineno-3-2" name="__codelineno-3-2"></a>
<a id="__codelineno-3-3" name="__codelineno-3-3"></a><span class="n">benchmark_suite</span> <span class="o">=</span> <span class="n">openml</span><span class="o">.</span><span class="n">study</span><span class="o">.</span><span class="n">get_suite</span><span class="p">(</span><span class="s1">&#39;OpenML-CC18&#39;</span><span class="p">)</span> <span class="c1"># obtain the benchmark suite</span>
<a id="__codelineno-3-4" name="__codelineno-3-4"></a>
Expand Down Expand Up @@ -5622,7 +5622,7 @@ <h3 id="fetching-details">Fetching details<a class="headerlink" href="#fetching-
<span class="normal"><a href="#__codelineno-5-4">4</a></span>
<span class="normal"><a href="#__codelineno-5-5">5</a></span></pre></div></td><td class="code"><div><pre><span></span><code><a id="__codelineno-5-1" name="__codelineno-5-1"></a><span class="nf">library</span><span class="p">(</span><span class="n">OpenML</span><span class="p">)</span>
<a id="__codelineno-5-2" name="__codelineno-5-2"></a><span class="n">task.ids</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="nf">getOMLStudy</span><span class="p">(</span><span class="s">&#39;OpenML-CC18&#39;</span><span class="p">)</span><span class="o">$</span><span class="n">tasks</span><span class="o">$</span><span class="n">task.id</span><span class="w"> </span><span class="c1"># obtain the list of suggested tasks</span>
<a id="__codelineno-5-3" name="__codelineno-5-3"></a><span class="nf">for </span><span class="p">(</span><span class="n">task.id</span><span class="w"> </span><span class="n">in</span><span class="w"> </span><span class="n">task.ids</span><span class="p">)</span><span class="w"> </span><span class="p">{</span><span class="w"> </span><span class="c1"># iterate over all tasks</span>
<a id="__codelineno-5-3" name="__codelineno-5-3"></a><span class="kr">for</span><span class="w"> </span><span class="p">(</span><span class="n">task.id</span><span class="w"> </span><span class="kr">in</span><span class="w"> </span><span class="n">task.ids</span><span class="p">)</span><span class="w"> </span><span class="p">{</span><span class="w"> </span><span class="c1"># iterate over all tasks</span>
<a id="__codelineno-5-4" name="__codelineno-5-4"></a><span class="w"> </span><span class="n">task</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="nf">getOMLTask</span><span class="p">(</span><span class="n">task.id</span><span class="p">)</span><span class="w"> </span><span class="c1"># download single OML task</span>
<a id="__codelineno-5-5" name="__codelineno-5-5"></a><span class="w"> </span><span class="n">data</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="nf">as.data.frame</span><span class="p">(</span><span class="n">task</span><span class="p">)</span><span class="w"> </span><span class="c1"># obtain raw data set</span>
</code></pre></div></td></tr></table></div>
Expand Down Expand Up @@ -5655,8 +5655,8 @@ <h3 id="running-and-sharing-benchmarks">Running and sharing benchmarks<a class="
<span class="normal"><a href="#__codelineno-6-15">15</a></span>
<span class="normal"><a href="#__codelineno-6-16">16</a></span>
<span class="normal"><a href="#__codelineno-6-17">17</a></span>
<span class="normal"><a href="#__codelineno-6-18">18</a></span></pre></div></td><td class="code"><div><pre><span></span><code><a id="__codelineno-6-1" name="__codelineno-6-1"></a><span class="kn">import</span> <span class="nn">openml</span>
<a id="__codelineno-6-2" name="__codelineno-6-2"></a><span class="kn">import</span> <span class="nn">sklearn</span>
<span class="normal"><a href="#__codelineno-6-18">18</a></span></pre></div></td><td class="code"><div><pre><span></span><code><a id="__codelineno-6-1" name="__codelineno-6-1"></a><span class="kn">import</span><span class="w"> </span><span class="nn">openml</span>
<a id="__codelineno-6-2" name="__codelineno-6-2"></a><span class="kn">import</span><span class="w"> </span><span class="nn">sklearn</span>
<a id="__codelineno-6-3" name="__codelineno-6-3"></a>
<a id="__codelineno-6-4" name="__codelineno-6-4"></a><span class="n">openml</span><span class="o">.</span><span class="n">config</span><span class="o">.</span><span class="n">apikey</span> <span class="o">=</span> <span class="s1">&#39;FILL_IN_OPENML_API_KEY&#39;</span> <span class="c1"># set the OpenML Api Key</span>
<a id="__codelineno-6-5" name="__codelineno-6-5"></a><span class="n">benchmark_suite</span> <span class="o">=</span> <span class="n">openml</span><span class="o">.</span><span class="n">study</span><span class="o">.</span><span class="n">get_suite</span><span class="p">(</span><span class="s1">&#39;OpenML-CC18&#39;</span><span class="p">)</span> <span class="c1"># obtain the benchmark suite</span>
Expand Down Expand Up @@ -5719,7 +5719,7 @@ <h3 id="running-and-sharing-benchmarks">Running and sharing benchmarks<a class="
<a id="__codelineno-8-2" name="__codelineno-8-2"></a><span class="nf">setOMLConfig</span><span class="p">(</span><span class="n">apikey</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="s">&#39;FILL_IN_OPENML_API_KEY&#39;</span><span class="p">)</span>
<a id="__codelineno-8-3" name="__codelineno-8-3"></a><span class="n">lrn</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="nf">makeLearner</span><span class="p">(</span><span class="s">&#39;classif.rpart&#39;</span><span class="p">)</span><span class="w"> </span><span class="c1"># construct a simple CART classifier</span>
<a id="__codelineno-8-4" name="__codelineno-8-4"></a><span class="n">task.ids</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="nf">getOMLStudy</span><span class="p">(</span><span class="s">&#39;OpenML-CC18&#39;</span><span class="p">)</span><span class="o">$</span><span class="n">tasks</span><span class="o">$</span><span class="n">task.id</span><span class="w"> </span><span class="c1"># obtain the list of suggested tasks</span>
<a id="__codelineno-8-5" name="__codelineno-8-5"></a><span class="nf">for </span><span class="p">(</span><span class="n">task.id</span><span class="w"> </span><span class="n">in</span><span class="w"> </span><span class="n">task.ids</span><span class="p">)</span><span class="w"> </span><span class="p">{</span><span class="w"> </span><span class="c1"># iterate over all tasks</span>
<a id="__codelineno-8-5" name="__codelineno-8-5"></a><span class="kr">for</span><span class="w"> </span><span class="p">(</span><span class="n">task.id</span><span class="w"> </span><span class="kr">in</span><span class="w"> </span><span class="n">task.ids</span><span class="p">)</span><span class="w"> </span><span class="p">{</span><span class="w"> </span><span class="c1"># iterate over all tasks</span>
<a id="__codelineno-8-6" name="__codelineno-8-6"></a><span class="w"> </span><span class="n">task</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="nf">getOMLTask</span><span class="p">(</span><span class="n">task.id</span><span class="p">)</span><span class="w"> </span><span class="c1"># download single OML task</span>
<a id="__codelineno-8-7" name="__codelineno-8-7"></a><span class="w"> </span><span class="n">data</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="nf">as.data.frame</span><span class="p">(</span><span class="n">task</span><span class="p">)</span><span class="w"> </span><span class="c1"># obtain raw data set</span>
<a id="__codelineno-8-8" name="__codelineno-8-8"></a><span class="w"> </span><span class="n">run</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="nf">runTaskMlr</span><span class="p">(</span><span class="n">task</span><span class="p">,</span><span class="w"> </span><span class="n">learner</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="n">lrn</span><span class="p">)</span><span class="w"> </span><span class="c1"># run constructed learner</span>
Expand Down Expand Up @@ -5772,7 +5772,7 @@ <h3 id="retrieving-runs-on-a-benchmarking-suites">Retrieving runs on a benchmark
<span class="normal"><a href="#__codelineno-11-3">3</a></span>
<span class="normal"><a href="#__codelineno-11-4">4</a></span></pre></div></td><td class="code"><div><pre><span></span><code><a id="__codelineno-11-1" name="__codelineno-11-1"></a><span class="n">benchmark.suite</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="nf">getOMLStudy</span><span class="p">(</span><span class="n">study</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="s">&quot;OpenML-CC18&quot;</span><span class="p">)</span>
<a id="__codelineno-11-2" name="__codelineno-11-2"></a><span class="n">run.ids</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="nf">extractOMLStudyIds</span><span class="p">(</span><span class="n">benchmark.suite</span><span class="p">,</span><span class="w"> </span><span class="s">&quot;run.id&quot;</span><span class="p">)</span>
<a id="__codelineno-11-3" name="__codelineno-11-3"></a><span class="n">runs</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="nf">rbindlist</span><span class="p">(</span><span class="nf">lapply</span><span class="p">(</span><span class="n">run.ids</span><span class="p">,</span><span class="w"> </span><span class="nf">function</span><span class="p">(</span><span class="n">id</span><span class="p">)</span><span class="w"> </span><span class="nf">listOMLRuns</span><span class="p">(</span><span class="n">run.id</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="n">id</span><span class="p">)))</span>
<a id="__codelineno-11-3" name="__codelineno-11-3"></a><span class="n">runs</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="nf">rbindlist</span><span class="p">(</span><span class="nf">lapply</span><span class="p">(</span><span class="n">run.ids</span><span class="p">,</span><span class="w"> </span><span class="kr">function</span><span class="p">(</span><span class="n">id</span><span class="p">)</span><span class="w"> </span><span class="nf">listOMLRuns</span><span class="p">(</span><span class="n">run.id</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="n">id</span><span class="p">)))</span>
<a id="__codelineno-11-4" name="__codelineno-11-4"></a><span class="c1"># TODO waiting for REST API</span>
</code></pre></div></td></tr></table></div>
</details>
Expand Down Expand Up @@ -5801,7 +5801,7 @@ <h3 id="creating-new-benchmark-suites">Creating new benchmark suites<a class="he
<span class="normal"><a href="#__codelineno-12-13">13</a></span>
<span class="normal"><a href="#__codelineno-12-14">14</a></span>
<span class="normal"><a href="#__codelineno-12-15">15</a></span>
<span class="normal"><a href="#__codelineno-12-16">16</a></span></pre></div></td><td class="code"><div><pre><span></span><code><a id="__codelineno-12-1" name="__codelineno-12-1"></a><span class="kn">import</span> <span class="nn">openml</span>
<span class="normal"><a href="#__codelineno-12-16">16</a></span></pre></div></td><td class="code"><div><pre><span></span><code><a id="__codelineno-12-1" name="__codelineno-12-1"></a><span class="kn">import</span><span class="w"> </span><span class="nn">openml</span>
<a id="__codelineno-12-2" name="__codelineno-12-2"></a>
<a id="__codelineno-12-3" name="__codelineno-12-3"></a><span class="c1"># find 250 tasks that we are interested in, e.g., the tasks that have between</span>
<a id="__codelineno-12-4" name="__codelineno-12-4"></a><span class="c1"># 100 and 10000 instances and between 4 and 20 attributes</span>
Expand Down Expand Up @@ -5902,7 +5902,7 @@ <h3 id="updating-a-benchmark-suite">Updating a benchmark suite<a class="headerli
<span class="normal"><a href="#__codelineno-15-29">29</a></span>
<span class="normal"><a href="#__codelineno-15-30">30</a></span>
<span class="normal"><a href="#__codelineno-15-31">31</a></span>
<span class="normal"><a href="#__codelineno-15-32">32</a></span></pre></div></td><td class="code"><div><pre><span></span><code><a id="__codelineno-15-1" name="__codelineno-15-1"></a><span class="kn">import</span> <span class="nn">openml</span>
<span class="normal"><a href="#__codelineno-15-32">32</a></span></pre></div></td><td class="code"><div><pre><span></span><code><a id="__codelineno-15-1" name="__codelineno-15-1"></a><span class="kn">import</span><span class="w"> </span><span class="nn">openml</span>
<a id="__codelineno-15-2" name="__codelineno-15-2"></a>
<a id="__codelineno-15-3" name="__codelineno-15-3"></a><span class="c1"># find 250 tasks that we are interested in, e.g., the tasks that have between</span>
<a id="__codelineno-15-4" name="__codelineno-15-4"></a><span class="c1"># 100 and 10000 instances and between 4 and 20 attributes</span>
Expand Down
4 changes: 2 additions & 2 deletions concepts/data/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -5485,8 +5485,8 @@ <h2 id="sharing">Sharing<a class="headerlink" href="#sharing" title="Permanent l
<span class="normal"><a href="#__codelineno-0-9"> 9</a></span>
<span class="normal"><a href="#__codelineno-0-10">10</a></span>
<span class="normal"><a href="#__codelineno-0-11">11</a></span>
<span class="normal"><a href="#__codelineno-0-12">12</a></span></pre></div></td><td class="code"><div><pre><span></span><code><a id="__codelineno-0-1" name="__codelineno-0-1"></a> <span class="kn">import</span> <span class="nn">pandas</span> <span class="k">as</span> <span class="nn">pd</span>
<a id="__codelineno-0-2" name="__codelineno-0-2"></a> <span class="kn">import</span> <span class="nn">openml</span> <span class="k">as</span> <span class="nn">oml</span>
<span class="normal"><a href="#__codelineno-0-12">12</a></span></pre></div></td><td class="code"><div><pre><span></span><code><a id="__codelineno-0-1" name="__codelineno-0-1"></a> <span class="kn">import</span><span class="w"> </span><span class="nn">pandas</span><span class="w"> </span><span class="k">as</span><span class="w"> </span><span class="nn">pd</span>
<a id="__codelineno-0-2" name="__codelineno-0-2"></a> <span class="kn">import</span><span class="w"> </span><span class="nn">openml</span><span class="w"> </span><span class="k">as</span><span class="w"> </span><span class="nn">oml</span>
<a id="__codelineno-0-3" name="__codelineno-0-3"></a>
<a id="__codelineno-0-4" name="__codelineno-0-4"></a> <span class="c1"># Create an OpenML dataset from a pandas dataframe</span>
<a id="__codelineno-0-5" name="__codelineno-0-5"></a> <span class="n">df</span> <span class="o">=</span> <span class="n">pd</span><span class="o">.</span><span class="n">DataFrame</span><span class="p">(</span><span class="n">data</span><span class="p">,</span> <span class="n">columns</span><span class="o">=</span><span class="n">attribute_names</span><span class="p">)</span>
Expand Down
Loading

0 comments on commit f5cc943

Please sign in to comment.