Skip to content

Commit b84cc26

Browse files
statirajustatiraju
authored
fix: Fix copyrights for new files added to documentation (#7921)
1 parent be17e91 commit b84cc26

23 files changed

+582
-153
lines changed

‎docs/backend_guide/vllm.rst

+27
Original file line numberDiff line numberDiff line change
@@ -1,3 +1,30 @@
1+
..
2+
.. Copyright 2024-2025, NVIDIA CORPORATION & AFFILIATES. All rights reserved.
3+
..
4+
.. Redistribution and use in source and binary forms, with or without
5+
.. modification, are permitted provided that the following conditions
6+
.. are met:
7+
.. * Redistributions of source code must retain the above copyright
8+
.. notice, this list of conditions and the following disclaimer.
9+
.. * Redistributions in binary form must reproduce the above copyright
10+
.. notice, this list of conditions and the following disclaimer in the
11+
.. documentation and/or other materials provided with the distribution.
12+
.. * Neither the name of NVIDIA CORPORATION nor the names of its
13+
.. contributors may be used to endorse or promote products derived
14+
.. from this software without specific prior written permission.
15+
..
16+
.. THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS ``AS IS'' AND ANY
17+
.. EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE
18+
.. IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR
19+
.. PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT OWNER OR
20+
.. CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL,
21+
.. EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT LIMITED TO,
22+
.. PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR
23+
.. PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY THEORY
24+
.. OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT
25+
.. (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE
26+
.. OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
27+
128
########
229
vLLM
330
########

‎docs/client_guide/api_reference.rst

+27
Original file line numberDiff line numberDiff line change
@@ -1,3 +1,30 @@
1+
..
2+
.. Copyright 2024-2025, NVIDIA CORPORATION & AFFILIATES. All rights reserved.
3+
..
4+
.. Redistribution and use in source and binary forms, with or without
5+
.. modification, are permitted provided that the following conditions
6+
.. are met:
7+
.. * Redistributions of source code must retain the above copyright
8+
.. notice, this list of conditions and the following disclaimer.
9+
.. * Redistributions in binary form must reproduce the above copyright
10+
.. notice, this list of conditions and the following disclaimer in the
11+
.. documentation and/or other materials provided with the distribution.
12+
.. * Neither the name of NVIDIA CORPORATION nor the names of its
13+
.. contributors may be used to endorse or promote products derived
14+
.. from this software without specific prior written permission.
15+
..
16+
.. THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS ``AS IS'' AND ANY
17+
.. EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE
18+
.. IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR
19+
.. PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT OWNER OR
20+
.. CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL,
21+
.. EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT LIMITED TO,
22+
.. PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR
23+
.. PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY THEORY
24+
.. OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT
25+
.. (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE
26+
.. OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
27+
128
####
229
API Reference
330
####

‎docs/client_guide/in_process.rst

+27
Original file line numberDiff line numberDiff line change
@@ -1,3 +1,30 @@
1+
..
2+
.. Copyright 2024-2025, NVIDIA CORPORATION & AFFILIATES. All rights reserved.
3+
..
4+
.. Redistribution and use in source and binary forms, with or without
5+
.. modification, are permitted provided that the following conditions
6+
.. are met:
7+
.. * Redistributions of source code must retain the above copyright
8+
.. notice, this list of conditions and the following disclaimer.
9+
.. * Redistributions in binary form must reproduce the above copyright
10+
.. notice, this list of conditions and the following disclaimer in the
11+
.. documentation and/or other materials provided with the distribution.
12+
.. * Neither the name of NVIDIA CORPORATION nor the names of its
13+
.. contributors may be used to endorse or promote products derived
14+
.. from this software without specific prior written permission.
15+
..
16+
.. THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS ``AS IS'' AND ANY
17+
.. EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE
18+
.. IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR
19+
.. PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT OWNER OR
20+
.. CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL,
21+
.. EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT LIMITED TO,
22+
.. PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR
23+
.. PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY THEORY
24+
.. OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT
25+
.. (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE
26+
.. OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
27+
128
####
229
In-Process Triton Server API
330
####

‎docs/client_guide/kserve.rst

+27
Original file line numberDiff line numberDiff line change
@@ -1,3 +1,30 @@
1+
..
2+
.. Copyright 2024-2025, NVIDIA CORPORATION & AFFILIATES. All rights reserved.
3+
..
4+
.. Redistribution and use in source and binary forms, with or without
5+
.. modification, are permitted provided that the following conditions
6+
.. are met:
7+
.. * Redistributions of source code must retain the above copyright
8+
.. notice, this list of conditions and the following disclaimer.
9+
.. * Redistributions in binary form must reproduce the above copyright
10+
.. notice, this list of conditions and the following disclaimer in the
11+
.. documentation and/or other materials provided with the distribution.
12+
.. * Neither the name of NVIDIA CORPORATION nor the names of its
13+
.. contributors may be used to endorse or promote products derived
14+
.. from this software without specific prior written permission.
15+
..
16+
.. THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS ``AS IS'' AND ANY
17+
.. EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE
18+
.. IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR
19+
.. PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT OWNER OR
20+
.. CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL,
21+
.. EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT LIMITED TO,
22+
.. PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR
23+
.. PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY THEORY
24+
.. OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT
25+
.. (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE
26+
.. OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
27+
128
####
229
KServe API
330
####

‎docs/client_guide/kserve_extension.rst

+27
Original file line numberDiff line numberDiff line change
@@ -1,3 +1,30 @@
1+
..
2+
.. Copyright 2024-2025, NVIDIA CORPORATION & AFFILIATES. All rights reserved.
3+
..
4+
.. Redistribution and use in source and binary forms, with or without
5+
.. modification, are permitted provided that the following conditions
6+
.. are met:
7+
.. * Redistributions of source code must retain the above copyright
8+
.. notice, this list of conditions and the following disclaimer.
9+
.. * Redistributions in binary form must reproduce the above copyright
10+
.. notice, this list of conditions and the following disclaimer in the
11+
.. documentation and/or other materials provided with the distribution.
12+
.. * Neither the name of NVIDIA CORPORATION nor the names of its
13+
.. contributors may be used to endorse or promote products derived
14+
.. from this software without specific prior written permission.
15+
..
16+
.. THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS ``AS IS'' AND ANY
17+
.. EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE
18+
.. IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR
19+
.. PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT OWNER OR
20+
.. CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL,
21+
.. EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT LIMITED TO,
22+
.. PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR
23+
.. PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY THEORY
24+
.. OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT
25+
.. (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE
26+
.. OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
27+
128
####
229
Extensions
330
####

‎docs/client_guide/python.rst

+27
Original file line numberDiff line numberDiff line change
@@ -1,3 +1,30 @@
1+
..
2+
.. Copyright 2024-2025, NVIDIA CORPORATION & AFFILIATES. All rights reserved.
3+
..
4+
.. Redistribution and use in source and binary forms, with or without
5+
.. modification, are permitted provided that the following conditions
6+
.. are met:
7+
.. * Redistributions of source code must retain the above copyright
8+
.. notice, this list of conditions and the following disclaimer.
9+
.. * Redistributions in binary form must reproduce the above copyright
10+
.. notice, this list of conditions and the following disclaimer in the
11+
.. documentation and/or other materials provided with the distribution.
12+
.. * Neither the name of NVIDIA CORPORATION nor the names of its
13+
.. contributors may be used to endorse or promote products derived
14+
.. from this software without specific prior written permission.
15+
..
16+
.. THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS ``AS IS'' AND ANY
17+
.. EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE
18+
.. IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR
19+
.. PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT OWNER OR
20+
.. CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL,
21+
.. EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT LIMITED TO,
22+
.. PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR
23+
.. PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY THEORY
24+
.. OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT
25+
.. (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE
26+
.. OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
27+
128
####
229
Python
330
####

‎docs/client_guide/python_readme.rst

+27-27
Original file line numberDiff line numberDiff line change
@@ -1,32 +1,32 @@
1+
..
2+
.. Copyright 2024-2025, NVIDIA CORPORATION & AFFILIATES. All rights reserved.
3+
..
4+
.. Redistribution and use in source and binary forms, with or without
5+
.. modification, are permitted provided that the following conditions
6+
.. are met:
7+
.. * Redistributions of source code must retain the above copyright
8+
.. notice, this list of conditions and the following disclaimer.
9+
.. * Redistributions in binary form must reproduce the above copyright
10+
.. notice, this list of conditions and the following disclaimer in the
11+
.. documentation and/or other materials provided with the distribution.
12+
.. * Neither the name of NVIDIA CORPORATION nor the names of its
13+
.. contributors may be used to endorse or promote products derived
14+
.. from this software without specific prior written permission.
15+
..
16+
.. THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS ``AS IS'' AND ANY
17+
.. EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE
18+
.. IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR
19+
.. PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT OWNER OR
20+
.. CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL,
21+
.. EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT LIMITED TO,
22+
.. PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR
23+
.. PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY THEORY
24+
.. OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT
25+
.. (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE
26+
.. OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
27+
128
.. raw:: html
229

3-
<!--
4-
# Copyright 2024, NVIDIA CORPORATION & AFFILIATES. All rights reserved.
5-
#
6-
# Redistribution and use in source and binary forms, with or without
7-
# modification, are permitted provided that the following conditions
8-
# are met:
9-
# * Redistributions of source code must retain the above copyright
10-
# notice, this list of conditions and the following disclaimer.
11-
# * Redistributions in binary form must reproduce the above copyright
12-
# notice, this list of conditions and the following disclaimer in the
13-
# documentation and/or other materials provided with the distribution.
14-
# * Neither the name of NVIDIA CORPORATION nor the names of its
15-
# contributors may be used to endorse or promote products derived
16-
# from this software without specific prior written permission.
17-
#
18-
# THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS ``AS IS'' AND ANY
19-
# EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE
20-
# IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR
21-
# PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT OWNER OR
22-
# CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL,
23-
# EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT LIMITED TO,
24-
# PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR
25-
# PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY THEORY
26-
# OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT
27-
# (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE
28-
# OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
29-
-->
3030

3131
Triton Inference Server In-Process Python API [BETA]
3232
====================================================

‎docs/contents.rst

+26-24
Original file line numberDiff line numberDiff line change
@@ -1,27 +1,29 @@
1-
# Copyright 2024, NVIDIA CORPORATION & AFFILIATES. All rights reserved.
2-
# Redistribution and use in source and binary forms, with or without
3-
# modification, are permitted provided that the following conditions
4-
# are met:
5-
# * Redistributions of source code must retain the above copyright
6-
# notice, this list of conditions and the following disclaimer.
7-
# * Redistributions in binary form must reproduce the above copyright
8-
# notice, this list of conditions and the following disclaimer in the
9-
# documentation and/or other materials provided with the distribution.
10-
# * Neither the name of NVIDIA CORPORATION nor the names of its
11-
# contributors may be used to endorse or promote products derived
12-
# from this software without specific prior written permission.
13-
#
14-
# THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS ``AS IS'' AND ANY
15-
# EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE
16-
# IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR
17-
# PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT OWNER OR
18-
# CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL,
19-
# EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT LIMITED TO,
20-
# PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR
21-
# PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY THEORY
22-
# OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT
23-
# (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE
24-
# OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
1+
..
2+
.. Copyright 2024-2025, NVIDIA CORPORATION & AFFILIATES. All rights reserved.
3+
..
4+
.. Redistribution and use in source and binary forms, with or without
5+
.. modification, are permitted provided that the following conditions
6+
.. are met:
7+
.. * Redistributions of source code must retain the above copyright
8+
.. notice, this list of conditions and the following disclaimer.
9+
.. * Redistributions in binary form must reproduce the above copyright
10+
.. notice, this list of conditions and the following disclaimer in the
11+
.. documentation and/or other materials provided with the distribution.
12+
.. * Neither the name of NVIDIA CORPORATION nor the names of its
13+
.. contributors may be used to endorse or promote products derived
14+
.. from this software without specific prior written permission.
15+
..
16+
.. THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS ``AS IS'' AND ANY
17+
.. EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE
18+
.. IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR
19+
.. PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT OWNER OR
20+
.. CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL,
21+
.. EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT LIMITED TO,
22+
.. PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR
23+
.. PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY THEORY
24+
.. OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT
25+
.. (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE
26+
.. OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
2527
2628
.. toctree::
2729
:hidden:

‎docs/getting_started/llm.md

+32-4
Original file line numberDiff line numberDiff line change
@@ -1,3 +1,31 @@
1+
<!--
2+
# Copyright (c) 2024-2025, NVIDIA CORPORATION. All rights reserved.
3+
#
4+
# Redistribution and use in source and binary forms, with or without
5+
# modification, are permitted provided that the following conditions
6+
# are met:
7+
# * Redistributions of source code must retain the above copyright
8+
# notice, this list of conditions and the following disclaimer.
9+
# * Redistributions in binary form must reproduce the above copyright
10+
# notice, this list of conditions and the following disclaimer in the
11+
# documentation and/or other materials provided with the distribution.
12+
# * Neither the name of NVIDIA CORPORATION nor the names of its
13+
# contributors may be used to endorse or promote products derived
14+
# from this software without specific prior written permission.
15+
#
16+
# THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS ``AS IS'' AND ANY
17+
# EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE
18+
# IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR
19+
# PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT OWNER OR
20+
# CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL,
21+
# EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT LIMITED TO,
22+
# PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR
23+
# PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY THEORY
24+
# OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT
25+
# (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE
26+
# OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
27+
-->
28+
129
# Deploying Phi-3 Model with Triton and TRT-LLM
230

331
This guide captures the steps to build Phi-3 with TRT-LLM and deploy with Triton Inference Server. It also shows a shows how to use GenAI-Perf to run benchmarks to measure model performance in terms of throughput and latency.
@@ -326,7 +354,7 @@ All config files inside /tensorrtllm\_backend/all\_models/inflight\_batcher\_llm
326354
<details>
327355
<summary><b> ensemble/config.pbtxt</b></summary>
328356

329-
# Copyright 2024, NVIDIA CORPORATION & AFFILIATES. All rights reserved.
357+
# Copyright (c) 2024-2025, NVIDIA CORPORATION & AFFILIATES. All rights reserved.
330358
#
331359
# Redistribution and use in source and binary forms, with or without
332360
# modification, are permitted provided that the following conditions
@@ -836,7 +864,7 @@ All config files inside /tensorrtllm\_backend/all\_models/inflight\_batcher\_llm
836864
<details>
837865
<summary><b>postprocessing/config.pbtxt</b></summary>
838866

839-
# Copyright 2024, NVIDIA CORPORATION & AFFILIATES. All rights reserved.
867+
# Copyright (c) 2024-2025, NVIDIA CORPORATION & AFFILIATES. All rights reserved.
840868
#
841869
# Redistribution and use in source and binary forms, with or without
842870
# modification, are permitted provided that the following conditions
@@ -965,7 +993,7 @@ All config files inside /tensorrtllm\_backend/all\_models/inflight\_batcher\_llm
965993
<details>
966994
<summary><b> preprocessing/config.pbtxt</b> </summary>
967995

968-
# Copyright 2024, NVIDIA CORPORATION & AFFILIATES. All rights reserved.
996+
# Copyright (c) 2024-2025, NVIDIA CORPORATION & AFFILIATES. All rights reserved.
969997
#
970998
# Redistribution and use in source and binary forms, with or without
971999
# modification, are permitted provided that the following conditions
@@ -1160,7 +1188,7 @@ All config files inside /tensorrtllm\_backend/all\_models/inflight\_batcher\_llm
11601188
<summary> <b> tensorrt_llm/config.pbtxt </b></summary>
11611189

11621190

1163-
# Copyright 2024, NVIDIA CORPORATION & AFFILIATES. All rights reserved.
1191+
# Copyright (c) 2024-2025, NVIDIA CORPORATION & AFFILIATES. All rights reserved.
11641192
#
11651193
# Redistribution and use in source and binary forms, with or without
11661194
# modification, are permitted provided that the following conditions

0 commit comments

Comments
 (0)