Current Meeting Report
Slides


2.3.3 Benchmarking Methodology (bmwg)

NOTE: This charter is a snapshot of the 53rd IETF Meeting in Minneapolis, MN USA. It may now be out-of-date. Last Modified: 01-Feb-02
Chair(s):
Kevin Dubray <kdubray@juniper.net>
Operations and Management Area Director(s):
Randy Bush <randy@psg.com>
Bert Wijnen <bwijnen@lucent.com>
Operations and Management Area Advisor:
Randy Bush <randy@psg.com>
Mailing Lists:
General Discussion:bmwg@ietf.org
To Subscribe: bmwg-request@ietf.org
In Body: subscribe your_email_address
Archive: ftp://ftp.ietf.org/ietf-mail-archive/bmwg/
Description of Working Group:
The major goal of the Benchmarking Methodology Working Group is to make a series of recommendations concerning the measurement of the performance characteristics of various internetworking technologies; further, these recommendations may focus on the systems or services that are built from these technologies.

Each recommendation will describe the class of equipment, system, or service being addressed; discuss the performance characteristics that are pertinent to that class; clearly identify a set of metrics that aid in the description of those characteristics; specify the methodologies required to collect said metrics; and lastly, present the requirements for the common, unambiguous reporting of benchmarking results.

Because the demands of a class may vary from deployment to deployment, a specific non-goal of the Working Group is to define acceptance criteria or performance requirements.

An ongoing task is to provide a forum for discussion regarding the advancement of measurements designed to provide insight on the operation internetworking technologies.

Goals and Milestones:
Done   Expand the current Ethernet switch benchmarking methodology draft to define the metrics and methodologies particular to the general class of connectionless, LAN switches.
Done   Edit the LAN switch draft to reflect the input from BMWG. Issue a new version of document for comment. If appropriate, ascertain consensus on whether to recommend the draft for consideration as an RFC.
Done   Take controversial components of multicast draft to mailing list for discussion. Incorporate changes to draft and reissue appropriately.
Done   Submit workplan for continuing work on the Terminology for Cell/Call Benchmarking draft.
Done   Submit workplan for initiating work on Benchmarking Methodology for LAN Switching Devices.
Done   Submit initial draft of Benchmarking Methodology for LAN Switches.
Done   Submit Terminology for IP Multicast Benchmarking draft for AD Review.
Done   Submit Benchmarking Terminology for Firewall Performance for AD review
Done   Progress ATM benchmarking terminology draft to AD review.
Done   Submit Benchmarking Methodology for LAN Switching Devices draft for AD review.
Done   Submit first draft of Firewall Benchmarking Methodology.
Done   First Draft of Terminology for FIB related Router Performance Benchmarking.
Done   First Draft of Router Benchmarking Framework
Done   Methodology for ATM Benchmarking for AD review.
Done   Progress Frame Relay benchmarking terminology draft to AD review.
Done   Terminology for ATM ABR Benchmarking for AD review.
Mar 01   Router Benchmarking Framework to AD review.
Jul 01   Terminology for FIB related Router Performance Benchmarking to AD review.
Nov 01   Methodology for IP Multicast Benchmarking to AD Review.
Nov 01   Firewall Benchmarking Methodology to AD Review
Nov 01   Net Traffic Control Benchmarking Terminology to AD Review
Nov 01   Resource Reservation Benchmarking Terminology to AD Review
Nov 01   EGP Convergence Benchmarking Terminology to AD Review
Dec 01   First Draft of Methodology for FIB related Router Performance Benchmarking.
Feb 02   First draft Net Traffic Control Benchmarking Methodology.
Feb 02   Resource Reservation Benchmarking Methodology to AD Review
Feb 02   Basic BGP Convergence Benchmarking Methodology to AD Review.
Jun 02   Methodology for FIB related Router Performance Benchmarking to AD review.
Nov 02   Net Traffic Control Benchmarking Methodology to AD Review.
Internet-Drafts:
Request For Comments:
RFCStatusTitle
RFC1242 Benchmarking Terminology for Network Interconnection Devices
RFC2285 Benchmarking Terminology for LAN Switching Devices
RFC2432 Terminology for IP Multicast Benchmarking
RFC2544 Benchmarking Methodology for Network Interconnect Devices
RFC2647 Benchmarking Terminology for Firewall Performance
RFC2761 Terminology for ATM Benchmarking
RFC2889 Benchmarking Methodology for LAN Switching Devices
RFC3116 Methodology for ATM Benchmarking
RFC3133 Terminology for Frame Relay Benchmarking
RFC3134 Terminology for ATM ABR Benchmarking
RFC3222 Terminology for Forwarding Information Base (FIB) based Router Performance

Current Meeting Report

None received.

Slides

None received.