Skip to content

Commit 01389b4

Browse files
author
olivedevteam
committed
Update docs from 68b1ee7
1 parent 46aeac5 commit 01389b4

File tree

3 files changed

+3
-3
lines changed

3 files changed

+3
-3
lines changed

reference/cli.html

+1-1
Original file line numberDiff line numberDiff line change
@@ -715,7 +715,7 @@ <h2>Named Arguments<a class="headerlink" href="#named-arguments" title="Link to
715715
<dd><p>Number of splits to use for model splitting. Input model must be an HfModel.</p>
716716
</dd>
717717
<dt><kbd>--cost-model</kbd></dt>
718-
<dd><p>Path to the cost model csv file to use for model splitting. Mutually exclusive with num-splits. Must be a csv with headers <cite>module,num_params,num_bytes</cite> where each row corresponds to the name or a module (with no children), the number of parameters, and the number of bytes the module uses when in the desired precision.</p>
718+
<dd><p>Path to the cost model csv file to use for model splitting. Mutually exclusive with num-splits. Must be a csv with headers <cite>module,num_params,num_bytes,num_flops</cite> where each row corresponds to the name or a module (with no children), the number of parameters, the number of bytes, and the number of FLOPs(batch_size=1, seqlen=1) the module uses when in the desired precision.</p>
719719
</dd>
720720
<dt><kbd>--mixed-precision-overrides-config</kbd></dt>
721721
<dd><p>Dictionary of name to precision. Has to be even number of entreis with even entries being the keys and odd entries being the values. Required only when output precision is “fp16” and MixedPrecisionOverrides pass is enabled.</p>

reference/pass.html

+1-1
Original file line numberDiff line numberDiff line change
@@ -3960,7 +3960,7 @@ <h1>Passes<a class="headerlink" href="#passes" title="Link to this heading">#</a
39603960
<dl class="std option">
39613961
<dt class="sig sig-object std" id="cmdoption-arg-cost_model">
39623962
<span class="sig-name descname"><span class="pre">cost_model</span></span><span class="sig-prename descclassname"></span><a class="headerlink" href="#cmdoption-arg-cost_model" title="Link to this definition">#</a></dt>
3963-
<dd><p>Path to the cost model csv file. One of num_splits or cost_model is required. Must be a csv with headers <cite>module,num_params,num_bytes</cite> where each row corresponds to the name or a module (with no children), the number of parameters, and the number of bytes the module uses when in the desired precision.</p>
3963+
<dd><p>Path to the cost model csv file. One of num_splits or cost_model is required. Must be a csv with headers <cite>module,num_params,num_bytes,num_flops</cite> where each row corresponds to the name or a module (with no children), the number of parameters, the number of bytes, and the number of FLOPs(batch_size=1, seqlen=1) the module uses when in the desired precision.</p>
39643964
<p><strong>type:</strong> str | pathlib.Path</p>
39653965
<p><strong>default_value:</strong> None</p>
39663966
<p><strong>search_defaults:</strong> None</p>

searchindex.js

+1-1
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

0 commit comments

Comments
 (0)