Back to Articles|Published on November 7, 2026|27 min read

GPUSmith Article

Keep or Replace a GPU Fleet? Carbon Payback Worksheet

Keep or replace a GPU fleet in 2026: a carbon payback worksheet using NVIDIA HGX H100 (1,312 kg) and B200 (2,274 kg) baseboard footprints, grid factors, PUE and no-payback cases.

By GPU Smith

Keep or Replace a GPU Fleet? Carbon Payback Worksheet

Summary

  1. 01Compare incremental future emissions at equal delivered service. Manufacturing carbon already embedded in retained equipment is sunk and should not be charged again to the keep option.
  2. 02Published baseboard footprints cover only part of a purchased configuration. Missing host, network, storage and facility footprints make baseboard-only payback an optimistic estimate.
  3. 03The vendor's 24% improvement is a normalized intensity per exaflop, not a reduction in absolute manufacturing carbon or a buyer's workload emissions.
  4. 04Measure facility energy on the buyer's workload, use dated grid factors and test the operating horizon. Rated power and benchmark results cannot replace equal-service measurements.
  5. 05Return no payback when operating savings are zero or negative, and unknown when an input is missing. Report a range when the evidence supports bounds rather than a single figure.
Inside this article
  1. 01Executive Summary
  2. 02Introduction and Background
  3. 03Key Changes in the Decision Frame
  4. 04Implementation Considerations and Process Changes
  5. 05Data Analysis and Evidence
  6. 06Implications and Future Directions
  7. 07Frequently Asked Questions (FAQs)
  8. 08Conclusion

Executive Summary

Deciding whether to keep a serviceable GPU fleet or buy a replacement fleet for an unchanged workload is a question about incremental future emissions, not about which chip is greener on a datasheet. The only manufacturing carbon that counts as new is the carbon of the products actually purchased. The carbon already embedded in retained equipment is sunk and is not charged again to the "keep" option. This report supplies a product-scope ledger and a keep-versus-replace worksheet, including an explicit unknown state, so a buyer can see whether measured energy savings repay new manufacturing carbon inside the planned operating horizon.

The public manufacturing numbers are narrow. NVIDIA reports 1,312 kg CO2e for one HGX H100 baseboard [1] and 2,274 kg CO2e for one HGX B200 baseboard [2], both cradle-to-gate (raw materials to factory exit), with use-phase and end-of-life emissions excluded [2]. A baseboard is not a server: it is paired with cooling and additional server components, as the vendor's own summary notes. The widely repeated 24% improvement is a different kind of number: a vendor-normalized intensity of 0.66 to 0.50 gCO2e per exaflop [3], not a 24% cut in absolute manufacturing carbon or in a buyer's workload emissions [3].

Operating-side inputs must be measured by the buyer. MLCommons states that measured power is valid only for the accompanying benchmark [4], and rated maximum power figures are nameplate limits, not consumption. Grid factors are dated and versioned: the latest U.S. EPA edition used here is eGRID2023 [5], while the IEA estimates global intensity at 435 g CO2/kWh in 2025, falling to 360 g CO2/kWh by 2030 [6].

Using only cited inputs, repaying a baseboard-only 2,274 kg CO2e requires about 6,500 kWh of avoided facility electricity at the U.S. eGRID2023 average and about 5,200 kWh at the IEA global figure (calculated below). Whether a real replacement achieves that depends on equal-service energy, utilization, additional replicas, power usage effectiveness (PUE) and the grid trajectory. Published modeling is mixed: one study finds replacing platforms older than four years could cut projected emissions by at least 75% in many carbon-intensive grids [7], while another shows offsetting new-hardware embodied carbon can take months to tens of years [8]. Those are model results, not measured fleet outcomes.

The decision therefore comes down to missing data, not missing arithmetic. No public full-server, network, storage or facility footprint accompanies the baseboard summaries. Until a vendor supplies product-boundary data for the whole purchased configuration, and the buyer supplies equal-service measurements, the defensible answer is a bounded interval or "unknown", never a single payback figure. Boundaries should be confirmed by a qualified lifecycle assessment practitioner before any figure is reported externally.

1,312 kg CO2eReported cradle-to-gate footprint of one HGX H100 baseboard, not a full server
2,274 kg CO2eReported cradle-to-gate footprint of one HGX B200 baseboard, not a full server
6,500 kWhApproximate avoided facility electricity to repay one B200 baseboard at the U.S. eGRID2023 average
5,200 kWhApproximate avoided facility electricity to repay one B200 baseboard at the IEA global 2025 factor

Introduction and Background

A GPU fleet that still meets its service objective carries a real option value. Replacing it creates new manufacturing emissions on day one, and any benefit arrives later as lower electricity use. For enterprise procurement teams, private AI operators and sustainability engineers, the question is whether that later benefit exceeds the upfront cost within the horizon the organization will actually operate the hardware. This worksheet frames the problem this way: fix the workload and service objective first, then compare fleets on incremental emissions, and treat missing boundary data as a first-class result.

Two kinds of numbers circulate and are often confused. Absolute product carbon footprints (PCFs) state kilograms of CO2 equivalent (CO2e) for a defined product and boundary. Normalized claims divide that footprint by a performance measure. NVIDIA's developer article by Zoe Kessler and Aditi Suresh [3] is the best-known example for GPUs: it compares HGX H100 and HGX B200 baseboards using summaries that were both based on a cradle-to-gate analysis [3]. The article has been referenced in other research contexts. For instance, a November 2025 California utility-program report prepared by Energy Solutions [9] notes in its introduction that hardware manufacturers like NVIDIA have announced a focus on reducing embodied carbon in their products [9], and lists the NVIDIA article in its bibliography [9]. That report concerns building materials, so it shows how the vendor method is being cited, not that the method has been independently validated for GPU purchasing. NVIDIA's own headline figure is a 24% decrease in embodied carbon emissions between the two generations [3].

The scale of the electricity side explains why the question matters. Lawrence Berkeley National Laboratory (LBNL) estimated U.S. data centers consumed 176 TWh in 2023, 4.4% of U.S. electricity [10], and projects roughly 325 to 580 TWh by 2028 [10]. Embodied carbon is a smaller but non-trivial counterweight. An early hyperscale analysis concluded that most emissions of modern data-center equipment come from hardware manufacturing and infrastructure rather than electricity use, in a setting where renewable procurement had already shrunk operational emissions [11].

This report does not rank Blackwell against Hopper and does not republish specification tables. Power-cap work is treated as upstream inputs. The added contribution is a boundary-aware ledger, a worked incremental calculation with unit checks, a sweep that exposes no-payback and unknown cases, and an evidence request a buyer can send to vendors. All numeric examples are either calculated from cited inputs or explicitly labeled hypothetical. Figures are as of November 2026.

Key Changes in the Decision Frame

Change 1: Fix the functional requirement before comparing fleets

A keep-or-replace comparison is valid only when both options deliver identical useful work at the same service level. That means the same model set, request mix, latency or throughput objective, availability target and data-residency constraints. A replacement fleet that serves more traffic, adds replicas for redundancy, or is run at higher utilization is a different decision and must be priced as such. The worksheet therefore starts with a service-equivalence statement, and the operating comparison uses energy per unit of delivered service measured under that statement, not peak throughput. The statement should fix at least:

  • Workload mix: models, context lengths, batch sizes and request distribution, stated as a replayable trace.
  • Service level: latency percentiles, throughput and availability targets that both fleets must meet.
  • Constraints: data residency, air-gap requirements and security controls that limit where and how hardware can run.
  • Growth: whether demand is flat, since added capacity for growth belongs to a separate decision.

Benchmark power data illustrate the caution. MLCommons states that MLPerf Power is only capable of measuring and validating full system power [4], and that the measured power is valid only for the accompanying benchmark [4]. The MLPerf Power paper describes a methodology built by a consortium of more than 20 organizations that collected 1,841 reproducible measurements from 60 systems [12]. These are useful as method templates. They are not a substitute for a buyer's own wall-power measurements on the buyer's own workload.

Change 2: Replace "the GPU's footprint" with a product-boundary ledger

The public PCFs describe an eight-GPU baseboard. NVIDIA states the HGX B200 baseboard result covers raw material extraction through baseboard assembly, and that the baseboard can be paired with advanced air or liquid cooling solutions and additional server components [2]. A purchased server also contains host CPUs, system memory, storage, network adapters, power supplies and a chassis. Third-party work shows how large those pieces can be: a bottom-up model amortizes a 1,780 kg CO2e Lenovo SR675 V3 base module across four accelerator slots [7], and a Dell PowerEdge R650 PCF (a general-purpose server, not a GPU server) reports a mean of 9,860 kg CO2e over its stated life [13]. Lenovo's own server sheets state that results are for the server only and that data-center values are not reported [14].

The ledger in Table 1 below lists each scope, its unit, the source status and the state the worksheet must record. Where no public source exists, the entry is UNKNOWN, which propagates into the result.

ScopeQuantity and unitSource status as of November 2026Worksheet state
Single GPU packagekg CO2e per GPUNo NVIDIA per-GPU PCF in the reviewed sources. An A100 card study gives 127.6 kg CO2e per GPU [15]. A parametric H100 model gives about 225 kg CO2e per card, against 164 kg from dividing the baseboard value by eight [16]Bounded (third-party, different method)
HGX H100 baseboard (8 GPUs)kg CO2e per baseboard, cradle-to-gate1,312 [1]. Use and end-of-life excludedKnown, baseboard only
HGX B200 baseboard (8 GPUs)kg CO2e per baseboard, cradle-to-gate2,274 [2]. Use and end-of-life excludedKnown, baseboard only
Host server platform (CPU, DRAM, chassis, PSU, NIC)kg CO2e per serverA 1,780 kg CO2e base module is cited in one model [7]. The model is an academic estimate, not a vendor PCF for the purchased configurationUNKNOWN until vendor supplies configured-product PCF
Storage (SSD, HDD)kg CO2e per TB or per driveArchitectural carbon model covers SSD and HDD by capacity but is described by its authors as a lower bound [17]Bounded or UNKNOWN
Network (switches, optics, cables)kg CO2e per port or per rackGoogle's TPU analysis excludes rack, shelf and network equipment from its totals [18]UNKNOWN
Facility changes (power, cooling, construction)kg CO2e per kW of IT capacityNo product-level public figure in the reviewed sourcesUNKNOWN unless a retrofit is required

Table 1 shows that only the two baseboard rows are backed by a vendor-published, reviewed number, and that every other row a procurement team needs is either a third-party estimate with a different boundary or empty. The practical consequence is that any payback computed from baseboard values alone is a lower bound on upfront manufacturing carbon, and therefore an optimistic (short) payback. A defensible report states that direction explicitly.

Change 3: Separate four kinds of carbon number

Four quantities answer four different questions, and mixing them is the most common source of error. Table 2 below classifies them, with an example drawn from cited inputs.

ClassUnitExample from cited inputsAnswersCannot answer
Absolute product carbon footprintkg CO2e per purchased product2,274 kg CO2e per HGX B200 baseboard (Table 1)How much manufacturing carbon enters the buyer's Scope 3 on purchaseWhether replacement lowers total future emissions
Vendor-normalized intensityg CO2e per unit of theoretical computation0.66 to 0.50 gCO2e per exaflop, FP16, a 24% decreaseHow the vendor's footprint compares per theoretical lifetime operationAbsolute savings or buyer workload emissions
Workload-allocated emissions (SCI style)g CO2e per functional unit RSCI is a rate: carbon emissions per one unit of R (Source: sci.greensoftware.foundation)How to apportion fleet emissions to a service or jobWhether to replace, because it spreads sunk emissions
Incremental replacement impactkg CO2e over a stated horizonNew manufacturing minus cumulative operating differenceWhether replacing reduces future emissions within the horizonReporting-year inventory totals

The 24% figure deserves a specific caution. The intensity is expressed per exaflop and is estimated based on FP16 precision [3]. A cross-check using the datasheet FP16 figures supports the reading that the ratio is driven by peak throughput. The B200 baseboard footprint is 1.73 times the H100 value (2,274 divided by 1,312, calculated), while the datasheet FP16 tensor throughput is 36 PFLOPS for the B200 baseboard [2] against 16 PFLOPS for the H100 baseboard [1] (both datasheet figures state sparsity footnotes), a ratio of 2.25. Dividing 1.73 by 2.25 gives 0.77, close to the 0.50 to 0.66 ratio of 0.76 (calculated). This is an inference from rounded public numbers, not a statement of NVIDIA's method, but it shows why the normalized figure cannot stand in for a buyer's measured energy per request.

Change 4: Keep allocation accounting apart from the incremental decision

The Green Software Foundation's Software Carbon Intensity (SCI) specification, published as ISO/IEC 21031:2024 (Source: webstore.iec.ch), allocates embodied emissions using M = TE * (TiR/EL) * (RR/ToR) (Source: sci.greensoftware.foundation), where EL is the expected lifespan, the anticipated time that the equipment will be installed (Source: sci.greensoftware.foundation). For grid electricity it requires short-run marginal, long-run marginal or average grid intensity (Source: sci.greensoftware.foundation). This is an attributional allocation: it spreads fleet emissions over services. The GHG Protocol Product Standard likewise attributes emissions to the unit of analysis of the studied product [19], and an academic review characterizes attributional life cycle assessment as attributing a share of the potential environmental impact of the world to a product (Source: research.vu.nl).

A keep-versus-replace choice is a consequential question: it asks what changes if a decision is made. The same review describes consequential assessment as assessing the environmental consequences of a decision, such as an increase of product demand (Source: research.vu.nl), and the GHG Protocol notes consequential approaches include processes in the boundary to the extent they are expected to change [19]. Practically, retaining equipment adds no new manufacturing emissions, because the manufacturing already happened. Charging an amortized share of it to the "keep" option and comparing against the "replace" option's full new manufacturing double counts the sunk carbon. The worksheet below therefore treats allocation (SCI) and incremental comparison as two separate calculations that share inputs but not totals.

A related reporting point: the GHG Protocol Scope 3 Standard says companies should not depreciate, discount or amortize the emissions from producing capital goods over time [20], so a purchase appears in full in the year of acquisition. Under that corporate-inventory convention a replacement year shows a spike, even when the decision view shows a net multi-year reduction. Both views are legitimate. They answer different questions and should be labeled.

Figure 01
Absolute footprint and normalized intensity answer different questions
Absolute product footprint
  • Reports kilograms of CO2e for a defined product and boundary.
  • Only manufacturing carbon from products actually purchased counts as new in the replacement decision.
Vendor-normalized intensity
  • Divides the footprint by a performance measure.
  • The 24% figure is per exaflop and does not measure a buyer's energy or absolute emissions.

A baseboard footprint leaves host servers, networking, storage and facilities outside the published boundary.

The worksheet treats allocation and incremental decisions separately, never charges sunk manufacturing to the retained fleet, and returns "no payback" or "unknown" when the evidence does not support a number.

Implementation Considerations and Process Changes

Step 1: Collect measured operating inputs for both options

For each option, record facility electricity under the service-equivalence statement, not rated power. Nameplate and design values are limits, not consumption. NVIDIA's DGX H100 guide describes six power supplies configured for 4+2 redundancy [21], its DGX B200 guide describes six in a 5+1 configuration [22], the H100 product page lists a maximum thermal design power of up to 700 W (configurable) [23], and the Blackwell datasheet lists configurable up to 1,000 W for HGX B200 [24]. None of these is measured energy for any buyer's workload, and none should enter the worksheet except as an upper-bound sanity check.

Measure at the wall or rack power distribution unit, over a period that includes realistic idle and reserve time, and record:

  • IT energy in kWh per defined period for each option, at equal delivered service.
  • Replica count and utilization, including redundancy that exists only for availability.
  • Idle and standby energy for hardware that is powered but not serving.
  • PUE or direct facility energy, because the carbon factor applies to facility kWh. Uptime Institute's 2026 survey reports an industry average PUE of 1.52 [25], LBNL estimates a U.S. average of 1.4 in 2023 [10], and Google reports a 2025 fleet average annual PUE of 1.09 for its own facilities (Source: datacenters.google). Use the actual site value, since averages vary by facility class.
  • Measurement dates and conditions, so the energy ledger can be re-run.

Step 2: Choose and date the grid factor

Pick a factor deliberately and record its source, geography, year, unit and method. The GHG Protocol Scope 2 Guidance defines the location-based method as reflecting the average emissions of the grids where consumption occurs [26] and the market-based method as reflecting emissions from electricity that companies have chosen [26]. Companies with operations in markets providing contractual instruments shall report scope 2 emissions in two ways [26]. A replacement decision should show results under both so the reader can see sensitivity to procurement claims.

Factors are versioned and lag the real grid. The guidance itself flags temporal representativeness problems due to time delays [26]. EPA's eGRID2023 was revised in June 2025 [27], and EPA's Power Profiler still reports 2023 eGRID data [5]. In the UK, the 2026 conversion-factor edition cut the electricity factor, with most of the decrease attributed to grid decarbonization [28]. Globally, Ember reports an average of 458 gCO2e/kWh in 2025 [29] and a 14% decline over the last decade [30], on a CO2-equivalent basis [31], while the IEA's figure is CO2 only, calculated as total CO2 emissions divided by total generation [6]. The two are not interchangeable.

Step 3: Compute incremental manufacturing and operating differences

Define, with explicit units:

  • ΔM (kg CO2e) = sum of new purchased product-scope footprints (baseboards, host servers, network, storage, installation, any facility retrofit) minus a documented reuse credit, if and only if the retired equipment has a verified second use. By default the credit is zero and the retained equipment contributes no new manufacturing term.
  • O(option, year) (kg CO2e) = facility kWh in that year × grid factor (kg CO2e/kWh) for that year.
  • ΔO(year) = O(keep, year) minus O(replace, year).
  • Cumulative position C(t) = ΔM minus the sum of ΔO over years 1 to t. Payback occurs in the first year where C(t) is zero or below.
  • Simple payback T = ΔM divided by annual ΔO, valid only when ΔO is positive and constant. If ΔO is zero or negative, there is no payback. If any input is unknown, the result is unknown.

Unit check: kg CO2e divided by (kWh per year × kg CO2e per kWh) leaves years. Facility kWh already includes PUE, so PUE must be applied once.

Step 4: Sweep the assumptions that move the answer

Vary each of the following one at a time, then in combination, and report the range rather than a point:

  • Utilization: average and peak load, including idle hours.
  • Remaining life: of the retained fleet, including repair and maintenance exposure.
  • Replacement life: the planned service period of the new fleet.
  • PUE: site-specific, before and after any facility change.
  • Grid trajectory: dated factors for each year, under both Scope 2 methods.
  • Redeployment and end-of-life: reuse credit at zero by default.

The published literature shows why the sweep matters: modeled outcomes swing widely with grid carbon intensity and lifetime. Four studies illustrate the spread:

  • A bottom-up study of GPU platforms finds that, in many medium-to-high carbon-intensity countries, replacing platforms older than four years could reduce projected emissions by at least 75% [7], yet it also reports that current platform prices discourage the timely replacement of inefficient hardware [7].
  • A database-server study finds that replacement can have a longer breakeven period, especially in regions with low-carbon electricity [8], and that break-even extends by 4× from Poland to the UK and by an additional 9× [8].
  • A hyperscale systems paper warns that upgrading every cloud server every two years would cause high embodied emissions [32], and that matching savings by extending lifetimes to 13 years requires a radical data center stack redesign [32].
  • A scheduling study reports that commonly used periodic replacement strategies are often sub-optimal in terms of total carbon emissions [33].

Step 5: Record redeployment and end-of-life explicitly

If retired GPUs are redeployed internally to displace a purchase that would otherwise occur, that avoided purchase is a legitimate part of ΔM, but it must be documented as a separate line. If they are resold, the effect on other buyers' purchases is uncertain, and the GHG Protocol requires that estimates of avoided emissions be reported separately from the scope 1, 2 and 3 inventory [20]. The ITU-T L.1410 recommendation, an ICT life cycle assessment framework (Source: www.itu.int), includes application scenarios for goods with extended operating lifetime and multiple life cycles (Source: www.itu.int). In the European Union, the server ecodesign regulation requires that joining techniques not prevent disassembly for repair or reuse (Source: eur-lex.europa.eu) and that a functionality for secure data deletion be made available (Source: eur-lex.europa.eu), which supports a documented reuse path. Default the reuse credit to zero unless evidence is on file.

Step 6: Publish a versioned ledger

Store every input with source, date, unit and owner, and re-run the worksheet whenever a grid factor, PCF revision, utilization measurement or price changes. The Evidence request list in the Implications section below gives the minimum vendor documents.

Figure 02
Build a measured, versioned keep-or-replace worksheet
  1. 01Measure equal-service energy

    Record facility electricity for both options under the same service-equivalence statement. Use measured consumption rather than rated power.

  2. 02Choose and date the grid factor

    Record the grid factor's source, geography, year, unit and method.

  3. 03Compute the cumulative position

    Subtract cumulative operating savings from new manufacturing carbon. Payback occurs when the cumulative position reaches zero or below.

  4. 04Sweep the assumptions

    Vary assumptions individually and in combination, then report the range rather than a single point.

  5. 05Document reuse credit

    Default the reuse credit to zero unless evidence is on file.

  6. 06Publish a versioned ledger

    Store sources, dates, units and owners. Re-run the worksheet when grid factors, footprint revisions, utilization measurements or prices change.

Replace when cumulative operating savings exceed new manufacturing carbon inside the shortest of remaining fleet life, replacement life and the planning horizon.

Return no payback when operating savings are zero or negative; return unknown when any input is unknown.

Data Analysis and Evidence

Break-even energy from cited inputs

The following figures are calculated from cited inputs and carry the baseboard-only caveat from Table 1. The U.S. factor is EPA's eGRID2023 total output emission rate, published in a summary-tables document [34]. Converting its U.S. value of 770.9 lb CO2e/MWh from pounds per megawatt-hour to kilograms per kilowatt-hour gives 0.350 kg CO2e/kWh (calculated). The IEA global estimate is 0.435 and Ember's is 0.458 (both kg per kWh, converted from the g/kWh figures cited above).

  • U.S. eGRID2023 average (0.350 kg/kWh): 2,274 kg ÷ 0.350 = about 6,500 kWh of avoided facility electricity to repay one B200 baseboard's manufacturing carbon.
  • IEA global 2025 (0.435 kg/kWh): about 5,200 kWh.
  • Ember global 2025 (0.458 kg/kWh): about 5,000 kWh.

For scale only: NVIDIA's H100 summary lists a typical baseboard power consumption of 5,600 W as a specification [1]. Running that continuously for a year would use about 49,000 kWh, so 6,500 kWh is roughly 13% of that nameplate figure (calculated). This comparison uses a rated value, not a measurement, and is shown only to illustrate magnitude. A replacement that does not cut facility energy by a double-digit percentage of the old baseboard's actual consumption cannot repay baseboard-only manufacturing carbon in about one year at the U.S. average factor, and a full-server boundary raises the bar further.

Hypothetical payback sweep

Table 3 below is a hypothetical sweep, not a finding. It applies T = ΔM / (annual avoided facility kWh × grid factor) with ΔM fixed at 2,274 kg CO2e (baseboard-only lower bound, one B200 baseboard purchased, zero reuse credit). The avoided-energy values are arbitrary placeholders to show sensitivity.

Hypothetical annual avoided facility energy per replaced baseboardU.S. eGRID2023 (0.350 kg/kWh)IEA global 2025 (0.435 kg/kWh)Ember global 2025 (0.458 kg/kWh)
2,000 kWh3.25 years2.61 years2.48 years
5,000 kWh1.30 years1.05 years0.99 years
10,000 kWh0.65 years0.52 years0.50 years
20,000 kWh0.32 years0.26 years0.25 years
Zero or negative (more replicas, higher utilization, unmeasured)No paybackNo paybackNo payback
Any component of ΔM or ΔE unknownUnknownUnknownUnknown

Table 3 shows that the grid factor changes the answer by roughly 30% across the three cited values, while the avoided-energy input changes it by an order of magnitude. That asymmetry is the argument for measuring equal-service energy before debating factors. The last two rows are not edge cases: if the replacement fleet is sized with additional replicas or runs at higher utilization to meet the same objective, avoided energy can be zero or negative. Because the table uses baseboard-only ΔM, every payback shown is shorter than a full-server calculation would give.

Grid trajectory example (hypothetical)

Constant factors overstate savings when the grid is decarbonizing. The IEA projects global intensity falling from 435 g CO2/kWh in 2025 to 360 g CO2/kWh in 2030 [6]. As a hypothetical illustration, interpolate linearly (0.435, 0.420, 0.405, 0.390, 0.375 kg/kWh for years 1 to 5) and assume 2,000 kWh avoided per year. Annual avoided emissions are 870, 840, 810, 780 and 750 kg CO2e, cumulative 870, 1,710, 2,520, 3,300 and 4,050. The cumulative position crosses ΔM = 2,274 kg during year 3, at about 2.7 years, against 2.61 years with a constant factor (calculated). The effect is small here but grows with longer paybacks.

Allocation example (hypothetical)

An SCI-style allocation for a workload that reserves 10% of a baseboard's resources for one year of a hypothetical 4-year expected lifespan gives M = 2,274 × (1/4) × 0.10 = 56.85 kg CO2e (calculated, baseboard-only). This number belongs in a service-level carbon report. It should not be subtracted from, or added to, the incremental replacement comparison, because the retained baseboard's manufacturing carbon is already sunk.

Lifetime and economic context

Lifetime assumptions vary by source and purpose, and accounting lives are not engineering lifetimes. Company filings give financial depreciation estimates for servers:

  • Alphabet: changed to six years effective fiscal 2023 [35].
  • Microsoft: completed a July 2022 assessment of server and network equipment lives, raising them from four to six years effective fiscal 2023 [36].
  • Amazon: shortened the life of a subset of servers and networking equipment effective January 1, 2025 [37], citing the increased pace of technology development [37].
  • Meta: extended certain servers and network assets to 5.5 years [38].
  • Oracle: increased the estimate of server and networking lives from five years to six years [39].
  • CoreWeave: a change from five to six years for computing equipment is recorded in its accounting policies [40].
  • LBNL: models average server lifetime reaching 5.7 years by 2023 [10].

Research assumptions are shorter: an architectural carbon model cites typical server-processor lifetimes of 3 to 5 years [17], and an early hyperscale paper notes data centers typically maintain server-class CPUs for three to four years [11]. Google's TPU life cycle assessment finds operational emissions dominate AI hardware lifetime at 70% or more [18], a result specific to its hardware, location and electricity procurement.

On cost, the U.S. Energy Information Administration reports average commercial electricity at 14.47 cents/kWh and industrial at 9.64 cents/kWh in August 2026 (preliminary) [41]. In the bottom-up GPU platform study, a five-year upgrade cycle would need an additional carbon incentive of about 87 USD/tCO2e on average to be justified on carbon grounds [7], and the same study puts the global average carbon price at 32 USD/tCO2e. For scale, valuing the 2.274 tonnes of one B200 baseboard at 32 USD/tCO2e gives about $73 (calculated), small next to hardware prices, which is one reason economic and carbon logic can diverge.

A total cost of ownership (TCO) calculator for the same decision uses the same ledger inputs:

  • Capital: purchase price of the replacement configuration minus resale value of retired units.
  • Energy cost: facility kWh per year × tariff, using the buyer's actual contract rather than a national average.
  • Operations: support, spares, space and staff time, which differ for older and newer fleets.
  • Carbon term (optional): ΔM and ΔO multiplied by an internal carbon price, reported separately from cash cost.

Implications and Future Directions

What a defensible answer requires

A defensible keep-or-replace carbon statement needs four things the public record does not currently provide together: a configured-product footprint for the whole purchased bill of materials, a stated reuse and end-of-life treatment, measured equal-service energy for both fleets, and dated grid factors under both location-based and market-based methods. The baseboard summaries are rigorous within their scope. NVIDIA reports primary supplier data for components representing over 92% of the H100 baseboard by weight [1], and a similar coverage statement for the B200 baseboard. The scope is nonetheless a baseboard. Outside the vendor documents, Computer Weekly's 2026 feature on measuring AI's carbon footprint reports that Gartner recommends accounting for the life cycle of datacentre equipment [42], consistent with the ledger approach here, though the feature gives no embodied-carbon values.

Evidence request for vendors and integrators

Before approving a replacement purchase, request in writing:

  • Configured-product PCF for the exact server SKU, with CPUs, memory, storage, NICs, power supplies and chassis itemized, plus revision date and reviewer.
  • Boundary statement naming what is excluded (thermal solutions, interconnects, packaging, cables, optics).
  • Method and databases used, with the standard followed. Dell describes a streamlined PAIA method developed by MIT for its server footprints [13] and notes its use phase assumes a PUE of 1.0 [13], so use-phase values must be rescaled.
  • Uncertainty range, such as percentile bounds, rather than a single point value.
  • Network, storage and rack bill of materials with footprints, or a statement that none exist.
  • Reuse, refurbishment and take-back terms for the retired fleet, including data-deletion support.
  • Energy per unit of service measured on the buyer's workload under a witnessed protocol, not peak or rated figures.

Versioned calculation ledger

Record each run in a structure such as:

run_id: 2026-11-07-r1
service_statement: <workload, SLO, availability>
horizon_years: <min of remaining life, replacement life, plan>
grid_factor: {source, geography, year, unit, method}
deltaM: {baseboard: <kg>, host: <kg|UNKNOWN>, network: <kg|UNKNOWN>, storage: <kg|UNKNOWN>, facility: <kg|UNKNOWN>, reuse_credit: 0}
energy_keep_kwh_per_year: <measured>
energy_replace_kwh_per_year: <measured>
pue: <site value>
result: payback_years | NO_PAYBACK | UNKNOWN

Where the field is heading

Three developments will change the worksheet. First, Scope 2 and product-carbon guidance are evolving, and grid datasets are re-issued with a lag, so ledgers must be re-run annually. Second, as grids decarbonize, operational savings shrink while embodied carbon stays fixed, tilting the balance toward retaining hardware. A model of server replacement finds that in high-carbon grids faster replacement is better as energy efficiency reduces emissions [43], which also implies the opposite in low-carbon grids. Third, vendors may publish configured-system footprints, which would turn many UNKNOWN cells into bounded ones. Teams that want support assembling the evidence request or the measurement plan can consult an advisor such as GPU Smith, the publisher of this report. This report is not lifecycle-specialist reviewed, and a qualified practitioner should confirm boundaries and factor choices before external disclosure.

Frequently Asked Questions (FAQs)

When should GPU servers be replaced? When the incremental calculation shows cumulative operating savings exceed ΔM inside the shortest of the old fleet's remaining life, the replacement's life and the planning horizon, and when equal-service energy has been measured. Otherwise the answer is keep, or unknown.

How does the GPU refresh cycle affect carbon payback? Shorter cycles add manufacturing carbon more often. A hyperscale analysis warns that replacing every two years would cause high embodied emissions [32]. Longer cycles delay efficiency gains. The optimum depends on grid intensity and measured efficiency gains.

Is embodied carbon larger than operational carbon for GPUs? It depends on boundary, grid and life. Google's TPU analysis finds operational emissions dominate at 70% or more [18], while an early hyperscale analysis finds manufacturing dominates where electricity is largely renewable [11].

What is a useful life for a GPU server? Financial lives in company filings cluster at five to six years [38], and research models use three to five [17]. Treat the planning horizon as an input, and test sensitivity.

Can the 24% figure be used as the carbon saving of replacing H100 with B200? No. It is a vendor-normalized intensity per exaflop, not a measure of a buyer's energy or absolute emissions.

How is a total cost of ownership calculator related? Total cost of ownership adds capital, energy cost (kWh × tariff), maintenance and residual value. The carbon worksheet uses the same energy and horizon inputs, so run both from one ledger.

Conclusion

Keep-or-replace decisions for working GPU fleets turn on a small set of auditable quantities: the manufacturing carbon of the exact configuration to be purchased, the measured difference in facility energy at equal service, the dated grid factor, and the planning horizon. Published baseboard footprints of 1,312 and 2,274 kg CO2e are rigorous inputs for what they cover, and they make clear what is missing: host servers, networking, storage and facilities. Normalized intensity claims and rated power figures cannot fill those gaps.

The worksheet treats allocation and incremental decisions separately, never charges sunk manufacturing to the retained fleet, and returns "no payback" or "unknown" when the evidence does not support a number. Published models point in both directions, with large reductions in carbon-intensive grids and long break-even in low-carbon ones. A buyer who obtains configured-product footprints and witnessed equal-service energy measurements can turn this worksheet into a decision. Until then, the honest result is a bounded interval with the missing inputs named.

External Sources (43)

About

GPUSmith

Plan and build private AI compute with GPU Smith. We connect workload requirements with GPU hardware, networking, deployment and operating decisions so your infrastructure fits the work it must perform.

GPU Smith provides independent engineering and research for private AI infrastructure. We help technical buyers and operators reason about GPU workload sizing, hardware selection, procurement, deployment and inference operations, from the compute system to the networking, power and cooling requirements around it.

Start with the workload

Useful infrastructure decisions begin with the models, data, throughput, latency and operating constraints a team actually has. GPU Smith helps connect those requirements with system design and deployment choices. The goal is a privately controlled AI environment whose capacity and operational demands are understood before a purchasing decision.

Hardware and supplier research

Our public reference library covers GPUs, complete systems and networking components. The server-vendor directory and manufacturing research help teams investigate suppliers, compare options and follow sources behind technical claims. We distinguish manufacturer specifications from measured benchmarks and advertised capabilities from tested configurations. Reference pages are research resources, not a live inventory listing or a binding equipment quote.

Deployment and operations

GPU Smith's engineering scope includes infrastructure integration, networking, power, cooling and the practical operation of inference workloads. Our published articles explain the tradeoffs behind deployment, procurement and ongoing operations so teams can ask better questions and document decisions.

Work with GPU Smith

Explore the hardware library, GPU references, networking references and vendor research. Contact GPU Smith with your workloads and deployment constraints to discuss a project and confirm current scope, pricing and availability.

Inclusion of a manufacturer or product in our research does not imply a partnership, certification or endorsement.

Disclaimer

This document is provided for informational purposes only. No representations or warranties are made regarding the accuracy, completeness, or reliability of its contents. Any use of this information is at your own risk. GPUSmith shall not be liable for any damages arising from the use of this document. This content was generated with assistance from artificial intelligence tools, which may contain errors or inaccuracies. Readers should verify critical information independently. All product names, trademarks, and registered trademarks mentioned are property of their respective owners and are used for identification purposes only. Use of these names does not imply endorsement. This document does not constitute professional or legal advice. For specific guidance related to your needs, please consult qualified professionals.