CALIBRATING MULTI- WIRE SKEW

CROSS-REFERENCE TO RELATED APPLICATIONS

[0001] This Application claims the benefit of U.S. Non-Provisional Application No. 15/881,512, filed January 26, 2018, naming Roger Ulrich, entitled“Method and System for Calibrating Multi-Wire Skew”, which is hereby incorporated by reference in its entirety for all purposes.

REFERENCES

[0002] The following prior applications are herein incorporated by reference in their entirety for all purposes:

[0003] U.S. Patent Publication 2011/0268225 of Application 12/784,414, filed May 20, 2010, naming Harm Cronie and Amin Shokrollahi, entitled “Orthogonal Differential Vector Signaling” (hereinafter [Cronie I]).

[0004] U.S. Patent Application No. 13/842,740, filed March 15, 2013, naming Brian Holden, Amin Shokrollahi and Anant Singh, entitled“Methods and Systems for Skew Tolerance in and Advanced Detectors for Vector Signaling Codes for Chip-to-Chip Communication”, hereinafter identified as [Holden I];

[0005] U.S. Patent Application No. 14/926,958, filed October 29, 2015, naming Richard Simpson, Andrew Stewart, and Ali Hormati, entitled“Clock Data Alignment System for Vector Signaling Code Communications Link”, hereinafter identified as [Simpson I]

[0006] U.S. Patent Application No. 14/717,717, filed May 20, 2015, naming Richard Simpson and Roger Ulrich, entitled“Control Loop Management and Differential Delay Detection and Correction for Vector Signaling Code Communications Links”, hereinafter identified as [Simpson II]

[0007] U.S. Patent Application No. 14/253,584, filed April 15, 2014, naming John Fox, Brian Holden, Ali Hormati, Peter Hunt, John D Keay, Amin Shokrollahi, Anant Singh, Andrew Kevin John Stewart, Giuseppe Surace, and Roger Ulrich, entitled“Methods and Systems for High Bandwidth Communications Interface” (hereinafter called [Fox I])

[0008] U.S. Patent Application No. 14/315,306, filed June 25, 2014, naming Roger Ulrich, entitled“Multilevel Driver for High Speed Chip-to-Chip Communications” (hereinafter called [Ulrich I]);

[0009] U.S. Patent Application No. 13/895,206, filed May 15, 2013, naming Roger Ulrich and Peter Hunt, entitled“Circuits for Efficient Detection of Vector Signaling Codes for Chip-to- Chip Communications using Sums of Differences”, hereinafter identified as [Ulrich II]

[0010] U.S. Patent Application No. 15/641,313, filed July 4, 2017, naming Roger Ulrich, Armin Tajalli, Ali Hormati, and Richard Simpson, entitled“Method for Measuring and Correcting Multi-Wire Skew”, hereinafter identified as [Ulrich III]

[0011] U.S. Patent Application No. 15/582,545, filed April 28, 2017, 2014, naming Ali Hormati and Richard Simpson, entitled“Clock Data Recovery Utilizing Decision Feedback Equalization” (hereinafter called [Hormati I]);

[0012] U.S. Provisional Patent Application No. 62/464,597, filed February 28, 2017, naming Ali Hormati and Kiarash Gharibdoust, entitled “Method for Measuring and Correcting Multiwire Skew” (hereinafter called [Hormati II]).

[0013] U.S. Provisional Patent Application No. 62/509,714, filed May 22, 2017, naming Armin Tajalli and Ali Hormati, entitled“Multi-modal Data-driven Clock Recovery Circuit” (hereinafter called [Tajalli I]).

[0014] U.S. Patent 9,100,232, issued August 4, 2015, naming Amin Shokrollahi, Ali Hormati, and Roger Ulrich, entitled“Method and Apparatus for Low Power Chip-to-Chip Communications with Constrained ISI Ratio”, hereinafter identified as [Shokrollahi I]

FIELD OF THE INVENTION

[0015] The present embodiments relate to communications systems circuits generally, and more particularly to measurement and reduction of differential signal arrival times for a received communications signal transmitted over a high-speed multi-wire interface used for chip-to-chip communication. BACKGROUND

[0016] In modem digital systems, digital information is processed in a reliable and efficient way. In this context, digital information is to be understood as information available in discrete, i.e., discontinuous values. Bits, collection of bits, but also numbers from a finite set can be used to represent digital information.

[0017] In most chip-to-chip, or device-to-device communication systems, communication takes place over a plurality of wires to increase the aggregate bandwidth. A single or pair of these wires may be referred to as a channel or link and multiple channels create a communication bus between the electronic components. At the physical circuitry level, in chip- to-chip communication systems, buses are typically made of electrical conductors in the package between chips and motherboards, on printed circuit boards (“PCBs”) boards or in cables and connectors between PCBs. In high frequency applications, microstrip or stripline PCB traces may be used.

[0018] Common methods for transmitting signals over bus wires include single-ended and differential signaling methods, referred to herein as non-retum-to-zero or NRZ signaling. In applications requiring high speed communications, those methods can be further optimized in terms of power consumption and pin-efficiency, especially in high-speed communications. More recently, vector signaling methods have been proposed to further optimize the trade-offs between power consumption, pin efficiency and noise robustness of chip-to-chip communication systems. In those vector signaling systems, digital information at the transmitter is transformed into a different representation space in the form of a vector codeword that is chosen in order to optimize the power consumption, pin-efficiency and speed trade-offs based on the transmission channel properties and communication system design constraints. Herein, this process is referred to as“encoding”. The encoded codeword is communicated as a group of signals, typically communicated essentially in parallel over multiple wires or communications channels, from the transmitter to one or more receivers. At a receiver, the received signals corresponding to the codeword are transformed back into the original digital information representation space. Herein, this process is referred to as“decoding”.

[0019] Regardless of the encoding method used, the received signals presented to the receiving device are sampled (or their signal value otherwise recorded) at intervals best representing the original transmitted values, regardless of transmission channel delays, interference, and noise. The timing of this sampling or slicing operation is controlled by an associated Clock and Data Alignment (CD A) timing system, which determines the appropriate sample timing. Where the group of signals is communicated essentially in parallel over multiple wires or communications channels, variations in propagation delay over the multiple wires or channels can cause elements comprising one group of signals or codeword to be received at different times. This “skew” may, if uncorrected, prevent codewords from being received as coherent entities, and thus thwart decoding.

BRIEF DESCRIPTION

[0020] To reliably detect the data values transmitted over a communications system, a receiver accurately measures the received signal value amplitudes at carefully selected times. For vector signaling codes communicated essentially in parallel, this timing selection is comprised of two parts: accurate sampling of individual codeword elements received on individual wires or communications channels, and accurate interpretation of the entire received codeword, regardless of timing variations in reception of its component elements.

[0021] These differential propagation times across the vector signaling code codeword may be caused by variations in transmission path length or propagation velocity, and may be constant or vary over time. Identifying and correcting such differential arrival times or“skew” will increase the timing window for proper reception, thus improving received signal quality. Accurately measuring skew at the receiver is essential to subsequent skew correction, which as one example may be performed by introducing variable delays into the individual wire or symbol data paths prior to codeword decoding.

[0022] Methods and systems are described for receiving, over a plurality of consecutive signaling intervals, a plurality of codewords, each codeword received as a plurality of symbols via wires of a multi-wire bus, the plurality of symbols received at a plurality of multi-input comparators (MICs), wherein each symbol is received by at least two MICs, generating, for each codeword, a corresponding linear combination of the received symbols, generating a plurality of composite skew measurement signals over the plurality of consecutive signaling intervals, each composite skew measurement signal based on samples of one or more linear combinations, and updating wire-specific skew values of the wires of the multi-wire bus, wherein one or more wire-specific skew values are updated according to composite skew measurement signals associated with linear combinations formed by at least two different MICs.

BRIEF DESCRIPTION OF FIGURES

[0023] FIG. 1 shows a system with a transmitter 110 communicating over channel 120 comprising a multi-wire bus having multiple wires 125 to receiver 130.

[0024] FIG. 2 illustrates one embodiment of a receiver for the ENRZ code utilizing receive clocks derived from received data transitions.

[0025] FIG. 3 illustrates one embodiment of a Clock Recovery subsystem as used in the receiver of FIG. 2.

[0026] FIG. 4 is a block diagram of a skew detection system, in accordance with some embodiments.

[0027] FIG. 5 shows one embodiment of an adjustable delay element for a wire of the multi wire bus, as used in the receiver of FIG. 2.

[0028] FIG. 6 is a block diagram of an exemplary sampler that may be used to provide data decisions and early/late indications, in accordance with some embodiments.

[0029] FIG. 7 is a block diagram of an alternative sampler that may be used to provide data decisions and early/late indications, in accordance with some embodiments.

[0030] FIG. 8 is a block diagram of a code sequence detection circuit, in accordance with some embodiments.

[0031] FIG. 9 is a block diagram of a logic circuit for generating wire delay adjustment enable signals, in accordance with some embodiments

[0032] FIG. 10 is a block diagram of a circuit for aggregating wire delays, in accordance with some embodiments.

[0033] FIG. 11 is a diagram of a receiver eye plot illustrating center-of-the-eye sampling. [0034] FIG. 12 is a state diagram associating particular code transitions with wire transitions. [0035] FIG. 13 is a block diagram of a method in accordance with some embodiments. [0036] FIG. 14 is a flowchart of a method, in accordance with some embodiments.

DETAILED DESCRIPTION

[0037] As described in [Cronie I], vector signaling codes may be used to produce extremely high bandwidth data communications links, such as between two integrated circuit devices in a system. Multiple data communications channels transmit symbols of the vector signaling code, acting together to communicate codewords of the vector signaling code. Depending on the particular vector signaling code used, the number of channels comprising a communications link may range from two to eight or more. Individual symbols, e.g. transmissions on any single communications channel, may utilize multiple signal levels, often three or more.

[0038] Embodiments may also apply to any communication or storage methods requiring coordination of multiple channels or elements of the channel to produce a coherent aggregate result.

Input sampling circuits

[0039] Conventional practice for a high-speed integrated circuit receiver includes terminating each data line (after any relevant front end processing such as amplification and frequency equalization) in a sampling device. This sampling device performs a measurement constrained in both time and amplitude dimensions; in one example embodiment, it may be comprised of a sample-and-hold circuit that constrains the time interval being measured, followed by a threshold detector or digital comparator that determines whether the signal within that interval falls above or below (or in some embodiments, within bounds set by) a reference value. In another embodiment, it may be comparable to an edge-triggered flip-flop, sampling the state of its input in response to a clock transition. Subsequently, this document will use the term sampling device, or more simply“sampler” to describe this receiver input measurement function as it implies both the time and amplitude measurement constraints, rather than the equivalent but less descriptive term“sheer” synonymously used in the art.

[0040] The receiver“eye plot” as illustrated in FIG. 11 graphically illustrates input signal values that will or will not provide accurate and reliable detected results from such measurement, and thus the allowable boundaries of the time and amplitude measurement windows imposed on the sampler. [0041] A Clock Data Alignment or CD A circuit supports such sampling measurements by extracting timing information, either from the data lines themselves or from dedicated clock signal inputs, and utilize that extracted information to generate clock signals to control the time interval used by the data line sampling device(s). The actual clock extraction may be performed using well known circuits such as a Phase Locked Loop (PLL) or Delay Locked Loop (DLL), which in their operation may also generate higher frequency internal clocks, multiple clock phases, etc. in support of receiver operation. These sampling clocks are“aligned” with the data to be sampled to optimize the quality and accuracy of the sampled results, typically by configuring the CDA so that sampling occurs when the signal to be sampled is stable, the so- called“center of eye” timing intervals identified by A and D in FIG. 11.

System environment

[0042] FIG. 1 illustrates an exemplary system, in accordance with some embodiments. As shown, FIG. 1 includes a transmitter 110 that receives source data S0-S2 100 and Clk 105, and an encoder 112 that encodes the information for transmission over a channel 120 including a multi-wire bus having multiple wires 125 via line driver 118. FIG. 1 further includes a receiver 130 including a detector 132 and in some embodiments includes a decoder 138, if needed, for producing receive data R0-R2 140 and a receive clock Rclk 145.

[0043] For purposes of description and without implying limitation, the following examples assume a communications system environment comprising interconnection of one transmitting and one receiving integrated circuit device via four wires of essentially equal path length and transmission line characteristics, at a signaling rate of 25 Gigabit/second/wire, equivalent to a transmission unit interval of 40 picoseconds. The Hadamard 4x4 vector signaling code of [Cronie I], also called [Fox I] the Enhanced NRZ or ENRZ code, is used to communicate three data values (each carried by a sub-channel of the vector signaling code, as subsequently described) over four wires, with a receive clock derived from transitions of the received data values. Other embodiments may include interconnection of one transmitting and one receiving integrated circuit device via six wires of essentially equal path length and transmission line characteristics, at a signaling rate of 25 Gigabit/second/wire, equivalent to a transmission unit interval of 40 picoseconds. The Glasswing vector signaling code of [Shokrollahi I], also called the 5b6w, Chord NRZ or (CNRZ) code, is used to communicate five data values (each carried by a sub-channel of the vector signaling code, as subsequently described) over six wires, with a receive clock derived from transitions of the received data values. [0044] It is assumed known methods for transmission pre-emphasis such as using Finite Impulse Response filtering, and receiver Continuous Time Linear Equalization (CTLE) and Decision Feedback Equalization (DFE) will be incorporated to provide adequate receiver signal quality.

[0045] Example communications channels may include skew, such as might be induced by variations in printed circuit board composition or wire routing, but for descriptive purposes the magnitude of this skew is assumed to be less than one unit interval. Embodiments correcting that amount of skew will in general address maximization of horizontal eye opening in a system in which the eyes are already partially open. Other embodiments may utilize the training sequences and methods described in [Hormati II] to achieve open eyes in a channel with larger amounts of skew, and further embodiments combining the described skew corrections with other known skew correction methods may be applied to environments with substantially greater amounts of skew, thus no limitation is implied.

[0046] One example embodiment of a communications receiver for vector signaling code is shown in FIG. 2. In that block diagram, four data wire inputs W0 through W3 from the multi wire bus are each processed by a delay element 200, the resulting signals then passed to Continuous Time Linear Equalizers (CTLE) 210 for optional amplification and/or frequency compensation. It is also common for CTLE circuits to be configured to provide additional high- frequency gain (also known as high frequency“peaking”) to compensate for frequency- dependent transmission medium losses. The resulting processed wire signals are presented to Multi-input comparators (MICs) 220, which decode the sub-channels of the vector signaling code MIC0 - MIC2. These sub-channel outputs are sampled via sampling circuits 230 at time intervals determined by Clock Recovery (CD A) subsystem 300, producing sub-channel 1 - 3 data outputs. As shown in FIG. 2, the receiver may operate in multiple phases and may include multiplexors 240 to sequentially output the sampled data for each phase. In an alternative embodiment, processing by delay element 200 occurs after CTLE 210 and before MIC 220.

[0047] In some embodiments, an apparatus includes a plurality of multi-input comparators (MICs) 220 configured to receive a plurality of codewords over a plurality of signaling intervals, each codeword received at the plurality of MICs as a plurality of symbols, each MIC configured to generate a corresponding linear combination for each received codeword. A skew correction circuit, an example of which is shown in FIG. 4, is configured to generate a plurality of composite skew measurement signals, each composite skew measurement signal formed based on one or more linear combinations generated in a single signaling interval of the plurality of signaling intervals. The linear combinations are generated by the MICs 220 forming a combination of the received symbols of the codeword. A plurality of wire-specific delay elements 200 are configured to store wire-specific delay values, each wire-specific delay value connected to a single wire of the multi-wire bus and to store a wire-specific delay value associated with said single wire, wherein one or more wire-specific delay elements are updated using composite skew measurement signals associated with linear combinations formed by at least two MICs during the plurality of signaling intervals.

[0048] In some embodiments, at least one of the plurality of composite skew measurement signals includes wire-specific skew components from all wires connected to a given MIC. In some embodiments, at least one of the plurality of composite skew measurement signals is generated based on linear combinations generated by at least two MICs.

[0049] Ins some embodiments, the apparatus further includes a code sequence detection circuit 440 configured to identify a valid codeword sequence, and wherein the plurality of wire- specific delay elements is updated in response to the identification of the valid codeword sequence. In some such embodiments, the code sequence detection circuit is further configured to identify a subset of wires associated with the valid codeword sequence.

[0050] In some embodiments, a wire-specific skew value of a given wire is updated in response to a subset of the composite skew measurement signals generated over the plurality of consecutive unit intervals exceeding an action threshold.

[0051] In some embodiments, each MIC is configured to implement the corresponding linear combination defined by a respective sub-channel vector of a plurality of mutually orthogonal sub-channel vectors. Examples of linear combinations based on sub-channel vectors are given below in Eqns. 2-4.

[0052] In some embodiments, the wire-specific delay elements are configured to adjust wire- specific delay values of a given wire by adjusting a capacitance associated with the given wire. In some such embodiments, the wire-specific delay element comprises a switched-capacitor network connected to the given wire. [0053] In some embodiments, the samples of the one or more linear combinations are compared to a pre-determined offset voltage, and the composite skew measurement signal represents an early-late indication signal.

[0054] In some embodiments, additional samplers are provided for some or all sub-channel outputs, to facilitate timing analysis and/or management. As one example, such an additional sampler may be triggered using an earlier or later clock to detect signal transitions and thus optimize CDA operation. As another example, such an additional sampler may be configured with an adjustable offset sheer voltage, to facilitate measurement of vertical eye opening. The sheer offset voltages may additionally incorporate DFE correction factors to provide both data and clock edge information, as described in [Hormati I] and in FIG. 6. FIG. 6 includes at least one stage of speculative DFE 650 supported by two data samplers performing concurrent time- sampling operations at two different amplitude thresholds. As shown, the data samplers include comparators 620 generating comparator output slicing the signal received from CTLE 210 and sampling the comparator output according to the sampling clock. One comparator output is chosen as the data value D and the other is chosen as an error signal in the form of an early late indicator, according to the most recent data decision. This signal is referred to herein as a signal skew characteristic. Using data value history 640, a pattern detection block 670 may identify patterns having transitions, and responsively use the skew measurement signal (shown as an early/late indication E/L) to identify wires involved in the transition and to responsively increment or decrement a corresponding wire-specific counter. Such selections of the data signal and early/late skew measurement signal may be performed using multiplexors 630 and 660. [Tajalli I] additionally describes how clock edge information from two or more sub channels may be combined, and how skew measurement information from sub-channels not experiencing a transition may be filtered from such combined results, providing improved timing feedback to the CDA subsystem.

[0055] FIG. 7 illustrates an alternative sampling mechanism that may be used in some embodiments. As shown, the output of MIC0 610 is processed by CTLE 210 as above, the output of which is sampled according to data sampler 702 and transition sampler 704. In such embodiments, the data signal from CTLE 210 may be sampled at a double rate. In at least one embodiment, the data may be sampled twice according to sampling clocks ck_000 and ck_l80 provided by sampling clock block 706. In some embodiments, the 180 degree out-of-phase clocks may be used in which one clock samples“middle of the eye” (see FIG. 11), while the other is used to sample the transition regions to obtain an early/late indication as a composite skew measurement signal. Alternatively, a full rate clock may be used while data is transmitted twice, effectively halving the data rate. In such embodiments, only one sampler may be used, the output of which alternates between a data sample and an edge sample. In such embodiments, a full-rate data transmission may be initiated or resumed after the half-rate skew training period has been completed. Further measurements and adjustments made then be performed using the full-rate methods and circuits described herein.

[0056] Differential arrival times or“skew” of the various wire signals may delay or interfere with proper detection of the vector signaling code. This skew may be caused by variations in transmission path element length or propagation velocity, and may be constant or vary over time. Thus, accurately measuring skew at the receiver is helpful for subsequent skew correction, which as one example may be performed by introducing variable delays into the individual symbol data paths prior to codeword decoding. In another example, measured skew values may be conveyed back to the transmitter where wire-specific timing adjustments may be made to pre-compensate for skew as seen by the receiver by adjusting the timing at which symbols of a codeword are provided to respective wires of the multi-wire bus.

Skew adjustment and compensation

[0057] Skew elimination includes incrementally offsetting individual wire signals in time to compensate for arrival time variations. Some methods for skew measurement, as one example, that of [Hormati II], also uses interactive adjustment of wire delays as part of their test and analysis procedure.

[0058] At the receiver, wire delay embodiments may incorporate known art methods in either the analog or digital domain utilizing variable delay elements, time adjustable sample-and-hold elements, adjustable FIFO buffers, etc.

[0059] [Hormati II] describes a low insertion loss Resistor/Capacitor filter inserted into each received wire signal, which is configurable for introducing small amounts of adjustable delay with minimal impact on signal amplitude. One such embodiment of a delay element 200 is shown in FIG. 5. Shown in the figure is a controllable delay circuit for a single wire, and each wire of the multi-wire bus may be configured with a similar circuit 200 to provide an adjustable amount of signal skew. Transistors 501, 502, and 503 may be enabled respectively by skew control inputs Bo, Bi, B ₂ to increase the wire input nodes’ capacitance to ground by amounts determined by capacitors Co, Ci, C ₂ . This added node capacitance, in association with the source and termination impedances of the incoming transmission line, introduces an increased delay into the wire signal. An alternative embodiment introduces the delay element 200 elsewhere in the wire signal path; as a non-limiting example, at the output of each CTLE stage rather than at the wire inputs of the receiver.

[0060] In one particular embodiment, Co, Ci, C ₂ values of 5 fF, 10 fF, 20 fF allows use of a binary skew control codeword that specifies binary increments of capacitance to be added, up to an additional aggregate capacitive value of 35 femtoFarads, corresponding to approximately 5 picoseconds of additional delay. In another embodiment, capacitors of equal value may be used, and the control word is implemented as a thermometer codeword rather than a binary codeword. As a side effect, the added capacitance also slightly degrades high frequency response, with the same embodiment experiencing 1.5 dB degradation in return loss (also generally known as Sn) at 12.5 GHz, when configured to introduce the maximum 5 psec delay.

[0061] Another embodiment capable of greater skew correction samples the wire signals using an analog track-and-hold or sample-and-hold circuit acting as Delay element 200, at skew- modified times during which the individual wire signals are stable, with sampling 140 of the resulting MIC sub-channel outputs using Sampling Clock being deferred by Clock Recovery system 150 until at least the latest of those skew-modified times. Some embodiments may utilize a series of such sampled delay elements per wire to provide increased delay time or reduced sampling signal artifacts.

[0062] Skew may also be eliminated by adjusting individual wire transmission times, as described by [Ulrich I] Such an approach communicates information gathered by the receiver, e.g. relative receive times on the various wires, to the transmitter so that the transmitter may adjust its wire transmission times accordingly. In some embodiments, additional information is communicated permitting variations in communication wire mapping, including transpositions and order reversals, to be identified and corrected. This communication may be driven by the receiver, or may be distributed by a separate command/control processor, in either case communicating over a return data channel, out of band command/control channel, or other communication interface using known art protocols and methods outside the scope of this document. Receiver Data detection

[0063] As described in [Holden I], vector signaling codes may be efficiently detected by linearly combining sets of input signals using Multi-Input comparators or mixers (MIC). Three instances of such multi-input comparator circuits operating on permutations of the same four input signals are sufficient to detect all code words of ENRZ. That is, given a multi-input comparator that performs the operation

R = (J + L) - (K + M) (Eqn. 1) where J, K, L, M are variables representing the four input signals values, then as one example and without limitation, the input permutations producing the three linear combination results Ro, Ri, R ₂ based on the equations representative of sub-channel vectors from a Hadamard H4 matrix are:

Ro = (W + Y) - (X + Z) (Eqn. 2)

Ri = (Y + Z) - (W + X) (Eqn. 3)

R ₂ = (Y + X) - (Z + W) (Eqn. 4)

The above linear combinations are sufficient to unambiguously identify each code word of the ENRZ code as represented by receive signal input values W, X, Y, Z. The results Ro, Ri, R ₂ are commonly described as sub-channels of ENRZ, in this example each being modulated by one bit of data.

[0064] As taught by [Ulrich II], functionally equivalent MIC configurations may be obtained by refactoring Eqns. 1 - 4 so that they represent the summation of two differences.

[0065] Various methods and systems described herein obtain skew measurements, such as early/late indications, from an aggregate data signal that is formed from a linear combination of data signals on the wires of a multi-wire bus. The aggregate data signals are referred to herein as sub-channel data signals, and are formed using a type of multi-input comparator circuit, or MIC 220, 610. The MIC forms the linear combination by combining the input signals according to the decoder coefficients, or decoder weights, as specified by rows of an orthogonal matrix, such as a Hadamard matrix or other orthogonal matrix as described herein. Thus, each row of the orthogonal matrix defines the elements of the sub-channel codeword, which are then summed to obtain the orthogonal codeword, each element of the orthogonal codeword being a sum of the respective elements of the sub-channel codewords. Depending on the code being used (ENRZ, CNRZ, or another orthogonal code having a plurality of orthogonal sub-channels), all of the wires may be used for each sub-channel data signal (e.g., ENRZ), or the sub-channel data signals may be based on a subset of the wires. In some embodiments, all of the wires may be used for only some of the sub-channel data signals while other sub-channel data signals use a subset of the wires (e.g., CNRZ).

[0066] In each type of MIC used to decode a sub-channel by combining wire signals, any signal skew that is present on the wires of the particular sub-channel data signal under consideration will be present to one degree or another in the aggregate sub-channel data signal itself. The degree to which the wire-specific skew affects the given MIC sub-channel output depends on a number of factors, including at least the signal level transition occurring on the corresponding wire, and the relative magnitude that is applied to the signal on that wire (as specified by the sub-channel row of the matrix, and hence the MIC circuit structure). While the MIC is a voltage domain linear combiner, it acts as a phase interpolator when used to extract timing information. The measured skew of the sub-channel output of the MIC, often in the form of an “early/late” determination relative to the receive clock from the CDR subsystem, may then be converted to a composite skew measurement signal that is attributed to the wires involved in the transition and may even be apportioned among the wires according to each wire’s relative contribution by taking into account the wire-specific level transitions as well as the corresponding sub-channel decoder coefficients of the MIC. Wire-specific skew offset values may then be generated by accumulating the results of a plurality of skew indicator signals. In some embodiments, the wire specific skew offset values may be generated by determined according to whether the composite skew measurement signals exceed a threshold, or the specific threshold that was exceeded in a given time period.

[0067] Because the measured skew is attributed to signal level variations on specific wires, and wire-specific MIC coefficients, either a training pattern with known signal level transitions on known wires may be sent, or the receiver may include a codeword detection circuit to identify what the signal level transitions would have been and the corresponding wires involved in the identified codeword transition(s). Pattern detection circuit 670 may be used to identify specific transitions and the wires involved in the corresponding identified transitions. Thus, the pattern detection circuit 670 may also identify the magnitude of the signal level transitions on the specific wires (according to the codes identified), and may accordingly adjust counter increment values to reflect the relative amount of skew contribution from the respective wires.

[0068] In some embodiments, a method comprises: generating, during a first and second signaling interval, an aggregated data signal by forming a linear combination of wire signals received in parallel from wires of a multi-wire bus, wherein at least some of the wire signals undergo a signal level transition during the first and second signaling interval; measuring a signal skew of the aggregated data signal; and, generating wire-specific skew offset values, each wire-specific skew offset value based on the signal skew measurement. That is, if the signal skew measurement is in the form of an early indication, then a counter for a wire involved in the transition may be decremented to decrease the wire-specific skew offset value, and if the signal skew measurement is a late indication, then the counter may be incremented. In some embodiments, the skew measurements correspond to composite skew measurements representing an aggregate combination of individual wire skew components for each wire involved in the transition. In some embodiments, the measurements made on multiple linear combinations produced by two or more MICs may be combined to form a composite skew measurement signal, including the wire-specific skew components of wires associated with the two or more MICs. The final count value may be used as the wire-specific skew offset value(s), or the number of times the count value exceeded a threshold may be used as the wire-specific skew offset value(s). In some embodiments, these wire-specific skew offset values may be used directly as a delay adjustment control signal by adjusting a capacitive loading of the corresponding wire at the receiver. In other embodiments, the values may be sent across a reverse channel to the transmitter, thereby allowing the transmitter to pre-compensate for the skew. In some embodiments, skew offset values may be sent to the transmitter only after a receiver’s ability to correct for skew has been reached. That is, once a capacitive loading or other delay mechanism at the receiver has been exhausted, the receiver may communicate a specific wire skew correction to the transmitter. The receiver may then compensate to the adjusted signal from the transmitter, thereby bringing the wire skew back within the range which the receiver may compensate for. The receiver may send specific values of wire-specific skew control signals, or may simply send wire-specific up and down indicators indicating an incremental correction. [0069] In a general characterization of the skew observed from forming linear combinations of wire signals of the wired-line multi-wire bus systems with m MICs, MICi, i = 0, ..., m-l, each MIC can be described by:

[0070] MICi = {ay, n}, j = 0, ... , n-l (Eqn. 5) where n is the number of wires. Here, ay are the corresponding decoder coefficients, and n is the comparison reference level (often set to zero for simplicity). This description can be rewritten as: where VMIC stands for the voltage domain operation of a MIC forming a linear combination of inputs. Here, a _{t j} are real numbers representing MIC coefficients, and W _j are real values corresponding to the instantaneous signal value on each wire. Now if the input wires each have a specific skew, At _W(j) , with respect to an arbitrary reference time, then the skew of the signal s(i) at the output of MICi can be estimated by:

(Eqn. 7)

where the signal level transition of wire j is given by Aw _j =W _j [now]-W _j [old], and wherein in some embodiments -1 < D\n, <+l indicates the normalized magnitude of the transition experienced by signals W _j on wire j (w _j = 0 if there is no transition). The voltage swing may be normalized according to the maximum value. As can be seen, the skew at the output of a MIC depends on the data pattern. Hence, it can potentially change between max(t _j ) and min(t _j ), depending on the input data pattern. The data dependent skew at the output of each sub-channel means that even in an ideal system without any ISI, the eye will be closed by max(t _j ) - min(t _j ), due to skew. Skew dependent eye closure does not occur in MICs described by a linear encoding/decoding scheme, such as NRZ, or ENRZ. In some coding schemes such as in CNRZ, skew can close the eye at the output of MIC due to its sensitivity to deterministic or random CM noise. [0073] Here it is assumed that |tj| « T (T is the data period or signaling interval, corresponding to lx UI). Close to the transition time, the signal value on each wire at time t « T can be approximated by:

[0074] W _j = bj (t + tj) (Eqn. 8)

[0075] From (Eqn. 8) and (Eqn. 6), the transition time at the output of sub-channel can be approximated by (Eqn. 7).

[0076] Indeed, (Eqn. 7) implies that each MIC is operating as a phase interpolator in the time domain. In other words, the transition time at the output of a MIC stage is a weighted interpolation of the transition times of the input signals. Hence, if a multi-wire receiver can be described with [ay, n], then the cross times at the output of MIC can be described by [ay by]. If this matrix is invertible, then one can precisely estimate the skew at the input of receiver. Otherwise, if [ay by] is not invertible, then it is not possible to calculate the input skew values and an alternative algorithm may be used to make the estimation.

[0077] In some embodiments using a GW code, some transmitter implementations exhibit a skew pattern T = [0, 0, ti, ti, 12, t ₂ ], corresponding to wires W = [wO, ... , w5]. This skew pattern is due to floor-plan of the transmitter. Using Eqn. 7, it can be shown that the expected skew at the output of receiver sub-channels is:

[0078] T _subch = [(ti+t ₂ )/3, ti/2, 0, ti/2+t ₂ /2, t ₂ ] (Eqn. 9)

[0079] Based on this calculation, the output of sub-channel five has the maximum skew, while the transition at the output of sub-channel two occurs as the earliest. As depicted in FIG. 15, the experimental data matches very well with the estimation made in Eqn. 9. Hence, Eqn. 9 can be used to estimate the skew between wires (ti and t ₂ ).

[0080] In one embodiment, an algorithm to compensate for skew in a system using the GW code may include:

(1) measuring the phase interpolator code (or an alternative signal that can be used to measure the skew between sub-channels) that identifies the crossing point of sub-channel, based on eye of sub-channel (4) (which involves only wires 4 and 5);

(2) make a similar measurement for other sub-channels; (3) use eq. (9) to estimate the skew corresponding to each wire.

[0081] In some embodiments, the measurement algorithm includes measuring the zero crossing points at the output of each Rx sub-channel. The receiver in Rx includes five sub channels (five MICs). The output of each MIC is sampled by four sheers corresponding to the quarter rate architecture of the receiver (i.e., each sheer operates at one quarter rate, taking turns in processing the full rate aggregate data signal of a given MIC). The procedure of measurement of some embodiments is as follows:

(1) Produce a periodic (e.g., 16 UI data, 8 UI high and 8 UI low) on one of the phases of the transmitter (this assumes a transmitter having multiple phases also).

(2) Measure cross point at the output of the 5 MICs, each one observed by 4 sheers. This gives 20 independent measurements.

(3) Go back to step (1) and transmit a new set of periodic data on a different phase of the transmitter. Repeat this flow until data is collected for all the four phases of the transmitter.

[0082] Suppose M0 is measurements that have been carried out corresponding to sub-channel 0. Here, a periodic data sequence has been sent on the transmitter and measured by the receiver sheers. The cross point of the received signal at the output of Rx MICs can be measured. This is done by rotating the sampling clock using a phase interpolator of the four sheers that are connected to each MIC.

MO = [ xO+yO+zO xl+yO+zl x2+y0+z2 x3+y0+z3

x0+yl+z3 xl+yl+z2 x2+yl+z3 x3+yl+z0

x0+y2+z2 xl+y2+z3 x2+y2+z0 x3+y2+zl

x0+y3+zl xl+y3+z0 x2+y3+zl x3+y3+z2 ]

[0083] The columns are measurements that have been done for different phases of the receive clock. For example, the column 0 shows four independent measurements coming out from the sheer of sub-channel zero, which is controlled with phase 000 (0-degree) receive clock. The rows however, refer to four different sets of data that have been transmitted from the transmitter. The row 0, for example, is the periodic data that has been produced by Tx phase

000 [0084] Meanwhile, here: x: refers to error or skew on Rx sampling clock y: refers to the error or the skew on the Tx clock that produces the output signal. For example, yO refers to the timing error on the Tx clock phase 000. z: refers to the non-linearity effect coming from PI (phase interpolator).

[0085] As can be seen, the 16 measurements done at the output of MIC corresponding to sub channel 0, may be used to calculate (or estimate) 12 independent parameters.

[0086] Considering all sub-channels, there will be five sets of measurements for the five MICs, each including 16 measurements, producing 80 individual measurements. Comparing measurements M0, Ml, M2, M3, and M4 helps to measure wire to wire skew. In some embodiments, a maximum likelihood approach may be used to extract the following items:

(a) Five inter-wire skew numbers

(b) Inter-phase clock skew numbers for Rx

(c) Inter-phase clock skew numbers for Tx

(d) Four numbers describing nonlinearity of the phase interpolator. Note that the non-linearity numbers for PI can be measured in only few data points.

[0087] ENRZ Coding: In some embodiments of an ENRZ scheme, |ay| = 0.25, for all i and j values. In some embodiments, the circuit is configured to select specific patterns in order to make measurements for wire skew. Additional embodiments using subsets of transitions in an ENRZ transceiver will be described.

Relationship between wires and codes in ENRZ

[0088] As discussed above, and in view of the detection equations Eqns. 2 - 4, there are difficulties inherent in performing measurements of received sub-channel signals and attempting to map that information back to variations in the received wire signals. Each sub channel is dependent on all four received wire signals, thus there is no obvious mathematical process to partition, factor out, or otherwise determine information about individual wire signals.

Table I

[0089] As shown in Table I, the wire signals used to encode codes 7, 1, 2, 4 utilize a single “+1” signal value and three“-1/3” signal values. (As ENRZ is abalanced vector signaling code, all signal values in a given codeword sum to zero.) Similarly, the wire signals used to encode codes 0, 6, 5, 3 utilize a single“-1” signal and three“+1/3” signals. More significantly, transitions between any of codes 7, 1, 2, 4 or between codes 0, 6, 5, 3 only change the signals on two wires. Thus, if any of, for example, codes 7, 1, 2, 4 is received followed by a different code from that same set, the transition between codes is associated with exactly two wires changing, and which two wires changed may be determined using the information in Table I. Identical conditions apply to consecutive occurrences of codes drawn from the set 0, 6, 5, 3.

[0090] These known two-wire transitions are associated with exactly two values changing in the received data“word” Ro, Ri, R ₂ . Such criterion is not by itself sufficient to identifying which two wires changed, however, as for example a transition between code 7 and code 1 due to changes in WireO and Wirel cause only Ro, Ri to change, but so do transitions between codes 0 and 6; Contrariwise, changes of only Ro, Ri may also be caused by transitions between codes 2 and 4, or between codes 3 and 5, due to changes in Wire2 and Wire3. Thus, an algorithm or circuit may be used to identify wire pairs associated with sub-channel transitions may identify particular sequential sets of codes. The particular wire order and codeword values used in this example were chosen for descriptive convenience, and in no way imply limitation.

Determining transition times

[0091] As previously mentioned, the system environment for these descriptions utilizes receiver clock recovery derived from transitions of the detected sub-channel data. To maximize the amount of information available to maintain proper clock alignment, it is common to monitor all received sub-channels. [Tajalli I] describes such a clock recovery system, in which individual phase detectors sensitive to transitions in each sub-channel produce phase error results, which are then summed to produce an aggregate error signal used to update the clock PLL phase. In one such embodiment, only results from sub-channels with valid transitions within the time interval of interest are summed; in an alternative embodiment, simple “bang/bang” phase comparators are used and summed without such filtration, with any anomalous error results produced by non-transitioning sub-channels being averaged out over time. Known art embodiments utilizing either baud-rate clock edge detection methods or double-rate clock edge sampling methods may also be used.

[0092] FIG. 3 illustrates a clock recovery circuit 300, for use in some embodiments. As shown, FIG. 3 includes multiple partial phase comparators 310, reach receiving a respective sub channel output. In such embodiments, each partial phase comparator only outputs a partial phase-error result if a transition has occurred on the respective sub-channel. A summation circuit 320 receives each partial phase error signal and generates a composite phase error signal that is filtered by the loop filter 330 (which may be a low-pass filter (LPF) to provide a low- frequency error signal) to the voltage controlled oscillator (VCO) 340. The clock recovery circuit 300 may further include a frequency divider 350 that receives the outputs of the VCO 340, divides the frequency down, and provides the signals to the phase interpolator 360, which provides interpolated signals to the phase comparators 310. As shown, the phase interpolator also receives a phase offset correction signal from clock/data phase control logic 370. Such a correction signal may account for process variations in the system. The outputs of the VCO 340 may be used as sampling clocks in a multi-phase system, one phase being shown in FIG. 4.

[0093] In the two-wire transitions of interest, two sub-channel results change, essentially simultaneously except for random circuit variations. Thus, two essentially identical phase error results are incorporated into the aggregate error signal during such transitions. The following algorithm captures the overall“early or late” status of the aggregate error signal, for use in correcting wire skew.

Skew Correction algorithm

[0094] Inputs to this algorithm include the received data, i.e. the detected sub-channel results Ro, Ri, R ₂ For purposes of explanation, they are described herein as identifying“codes”, i.e. particular wire and result combinations, as previously described relative to Table I. Information from at least two consecutively received unit intervals is obtained, here called code(N) and code(N+l), along with the detected or measured skew in the form of a clock phase error associated with that time interval, which may be a signed magnitude indicating the amount that the received transitions were earlier or later than the expected clock time, or as little as a simple binary sign indicating“early/late”. Thus, in two consecutively received unit intervals in which one or more of the detected sub-channel results transition, such transitions include information for generating a composite skew measurement signal corresponding to an aggregation of skew on one or more wires undergoing a signal transmission change on the multi-wire bus.

[0095] The information may be obtained by continuous observation of the received data stream (as one example, using a finite state machine,) or may be obtained by statistically valid sampling of the data stream (as one example, by a software process running on a control or management processor periodically requesting and receiving sequences of received data, such samples spanning at minimum two consecutively received unit intervals and the associated clock phase error information.

[0096] Outputs from this algorithm are running estimates of the relative arrival times of signals on the four wires, which may be used to immediately or periodically adjust wire-specific skew values in wire signal delay elements, or request or indicate comparable per-wire timing adjustments be made by the transmitter. In one embodiment, said running estimates are immediately used to adjust receiver wire delays. In another embodiment, running estimates are maintained as variables in memory, with adjustments initiated when the absolute positive or negative magnitude of the variable exceeds a predetermined threshold, thus filtering out small perturbations.

[0097] Another embodiment of the algorithm in Verilog is provided as Appendix I.

Static signed integer WireO, Wirel, Wire2, Wire3 Calculate_skew( Data(N), Data(N+l), signed integer Error)

{

if Data(N) == 7 && Data(N+l) == 1 || Data(N) == 1 && Data(N+l) == 7 WireO += Error

Wirel += Error

break; else if Data(N) == 0 && Data(N+l) == 6 Data(N) == 6 && Data(N+l) == 0 WireO += Error

Wirel += Error

break; else if Data(N) == 7 && Data(N+l) == 2 Data(N) == 2 && Data(N+l) == 7 WireO += Error

Wire2 += Error

break; else if Data(N) == 0 && Data(N+l) == 5 Data(N) == 5 && Data(N+l) == 0 WireO += Error

Wire2 += Error

break; else if Data(N) == 2 && Data(N+l) == 4 Data(N) == 4 && Data(N+l) == 2 Wire2 += Error

Wire3 += Error

break; else if Data(N) == 5 && Data(N+l) == 3 Data(N) == 3 && Data(N+l) == 5 Wire2 += Error

Wire3 += Error

break; else if Data(N) == 1 && Data(N+l) == 4 || Data(N) == 4 && Data(N+l) == 1

Wirel += Error

Wire3 += Error

break; else if Data(N) == 6 && Data(N+l) == 3 || Data(N) == 3 && Data(N+l) == 6

Wirel += Error

Wire3 += Error

break; else if Data(N) == 1 && Data(N+l) == 2 || Data(N) == 2 && Data(N+l) == 1

Wirel += Error

Wire2 += Error

break; else if Data(N) == 6 && Data(N+l) == 5 || Data(N) == 5 && Data(N+l) == 6

Wirel += Error

Wire2 += Error

break; else if Data(N) == 7 && Data(N+l) == 4 || Data(N) == 4 && Data(N+l) == 7

WireO += Error

Wire3 += Error

break; else if Data(N) == 0 && Data(N+l) == 3 || Data(N) == 3 && Data(N+l) == 0

WireO += Error

Wire3 += Error

break;

}

[0098] The‘if statements correspond exactly to the transition conditions shown in the state diagram of FIG. 12, where consecutive codes of 7 followed by 1, or of 1 followed by 7 are associated with wireO and wirel, as are code transitions between 0 and 6. [0099] As there is no way of determining which of the two transitioning wires is the source of the early or late timing in the composite skew measurement signal, the variables representing skew offset metrics for both wires are updated equally. If, for example, subsequent transitions associated with codes 0 and 5 also update wireO and wire2 in the same direction, it is likely that wireO, common to both measurements, is the source of the timing error. Thus, the algorithm may be run over a number of different samples to provide a reasonable estimate of wire-specific skew values. As previously mentioned, at least one embodiment utilizes an action threshold before accumulated timing error values cause actual timing modifications to reduce random timing adjustments associated with these measurement artifacts. In some such embodiments, the timing adjustment on a given wire is adjusted by a predetermined step value responsive to the accumulation of the timing error values. Such a predetermined step value may be a capacitance change associated with a timing delay representative of the action threshold, which may correspond to e.g., a change in a counter value that exceeds a threshold amount. In some embodiments, wires may be individually updated in response to an accumulation of timing error values exceeding the action threshold, while alternative embodiments may update all wires according to their current respective wire-specific delay values in response to a single wire accumulating timing error values exceeding the action threshold. Other embodiments adjust wire timings immediately, presuming that small adjustments even in the wrong direction will introduce minimal error, while continued adjustments in the same direction will eventually produce an optimized eye opening.

[0100] FIG. 4 is a block diagram of a receiver configurable for performing the skew detection algorithm described above. As shown, FIG. 4 includes MICs 220 as described above for receiving the signals on the wires and responsively generating aggregated data signals representing the sub-channel outputs R0-R2. The sub-channel outputs are sampled 430, the samplers configured to provide data outputs Do-2 for each sub-channel, as well as composite skew measurement signals including early/late indication signals E/Lo-2 for each sub-channel. In some embodiments, samplers 430 may take the form of the samplers shown in FIG. 6 or FIG. 7 as described above. FIG. 4 includes a code sequence detection block 440 for detecting valid sets of sequentially received bits (each set representing a code 0 through 7 as described above). Such sequences are illustrated in the state diagram of FIG. 12. In some embodiments, DFE may be provided by the code sequence detection block 440, which may be used by the samplers 430 in embodiments using e.g., the samplers shown in FIG. 6. [0101] FIG. 8 illustrates a block diagram of a code sequence detection block, in accordance with some embodiments. In some embodiments, the code sequence detection block may be implemented using D flip flops 805 and 810 being sampled by a delayed 815 version of the sampling clock to allow time for buffering. Current detected bits b0-b2 and previously detected bits prev_b0-b2 are analyzed by a logic circuit 820 to see if a valid code sequence is detected. If a valid code sequence is detected, wire delay adjustment enable signals w0-w3_enable are provided to the aggregate wire delay block 460 shown in FIG. 4. As described above, in the embodiment of the H4 code, two wires are involved in any valid code sequence detected by logic circuit 820. In such embodiments, only two of the wire delay adjustment enable signals w0-w3_enable will be‘ls’, while the other two are‘0’ (thus not updating delay values in aggregate wire delay block 460).

[0102] In alternative embodiments, other sequences may be used, in addition to or instead of the ones involving only two wires. For example, the code sequence detection circuit 670 may identify transitions where each wire changes sign, but maintains the same magnitude, such as the codeword [-1, 1/3, 1/3, 1/3] changes to [1, -1/3, -1/3, -1/3] or [-1/3, 1, -1/3, -1/3] changes to [1/3, -1, 1/3, 1/3], and so on. This set of transitions includes 8 sets of codeword sequences. In these transitions, the magnitudes of the wire-specific transitions are considered and the skew metrics are updated accordingly. In particular, skew observed or measured at the MIC output for a codeword change from [-1, 1/3, 1/3, 1/3] to [1, -1/3, -1/3, -1/3] may be weighted according to the transition magnitudes given by: abs((wire(codel , i) - wire(code2, i)*mic(wire(i)), or in this case, [2, 2/3, 2/3, 2/3] That is, skew on wire W0 will have 3 times the impact on observed MIC output skew relative to skew on any other wire. The counter increments may be adjusted according to the identified transition magnitudes to properly reflect the relative contribution of skew from each of the wires.

[0103] FIG. 9 illustrates a block diagram of a logic circuit 820, in accordance with some embodiments. The example of FIG. 9 illustrates the valid code sequence from code‘G in Table I to code‘7’. Such a logic circuit may be implemented as an AND gate 905, in which the output of gate 905 is high if bits b0-b2 corresponding to code‘G =‘00G and if previously received bits prev_b0-b2 corresponding to code‘7’ =‘11 G. A control circuit 910 may analyze the outputs of all such detection gates, and may output wire delay adjustment enable signals wO- w3_enable to the aggregate wire delay block 460. The enable signals indicate which counters should be adjusted (incremented or decremented according to the signal skew characteristic). In addition, the count increment may also be weighted as described herein according to the relative magnitudes of the wire signal level transitions. In some embodiments, the control circuit 910 may implement control logic that implements Table II below:

Table II

[0104] FIG. 4 further includes a matrix error combiner 450 configured to receive the early/late indication signals from the plurality of sub-channels E/Lo-2, and to generate a final early/late decision to provide to aggregate wire delay block 460 to increment or decrement the stored delay values accordingly. As noted above and illustrated in Table I, in any given valid code sequence for some embodiments, only two sub-channels R0-R2 change. Thus, the E/L signal provided by the sub-channel that does not change is not useful, and logic may be included to omit the effects of such an indication. Nevertheless, the two sub-channels that do change will both provide E/L indications that are early or late, and thus the combination of such E/L indications will overcome the E/L indication of the non-transitioning sub-channel, and the final E/L indication provided by matrix error combiner 450 will remain valid.

[0105] FIG. 10 illustrates an exemplary block diagram of aggregate wire delay block 460, in accordance with some embodiments as shown, aggregate wire delay block includes four blocks 1005, 1010, 1015, and 1020; one for each wire of the multi-wire bus. In some embodiments, each block corresponds to a counter that may be selectably enabled according to the corresponding received wire delay adjustment enable signals w0-w3_enable. Each counter may also be configured to receive the E/L indication signal from the matrix error combiner 450, which may be used to control each counter to either count up or down (U/D), depending on the E/L indication signal. Each counter may increment according to a delayed 470 version of the sampling clock. In some embodiments, the values stored in each counter may be provided (e.g., as binary bits) to a respective wire delay adjustment circuit, as shown for example in FIG. 5.

[0106] FIG. 13 illustrates a flowchart of a method 1300, in accordance with some embodiments. As shown, method 1300 incudes obtaining consecutive received data values 1302. The received data values are analyzed 1304 to determine if the data corresponds to a set of single- wire-pair transitions. If the determination is“No”, then the process starts again from the beginning for the next set of received data. If the determination is“Yes,” the wires associated with the code transition are identified 1306, for example using control logic 910 described above with respect to Table II. Based on the identified wires, the running wire counts representing the aggregate delay values are updated 1308 based on the received E/L information. Once the running error count for a given wire reaches an action threshold 1310, the wire-specific delay for that wire is adjusted according to the stored error count 1312. In some embodiments, the wire-specific delay values may be initialized such that the wires have no delay applied. The algorithm may subsequently increase delays of each wire until all wires are delayed with respect to the slowest wire, which maintains a delay value corresponding to no delay. Alternatively, each wire may be initialized such that the wires have some predetermined initialized delay value, and the skew correction algorithm increases/decreases delays based on the composite skew measurement signals. Additionally, once skew has been corrected across the multi-wire bus, the wire-specific delay values may be decreased by an amount equal to the wire having the smallest wire-specific delay value such that the latest wire does not undergo any delay, and the rest of the wires have wire-specific delay values with respect to the latest wire.

[0107] The embodiments above describe correcting skew using vector signaling codes having codewords representing a combination of multiple sub-channels, the codewords being received over a multi-wire bus. It is further noted that each wire serves as an input to at least two MICs, thus the skew value of each wire may be updated using outputs of at least two different MICs, providing a uniform skew relationship across the wires of the multi-wire bus. At least one goal of the skew correction algorithm is to adjust wire-specific delay values for all wires on the multi-wire bus to provide larger eye openings at all the MICs.

[0108] FIG. 14 illustrates a flowchart of a method 1400, in accordance with some embodiments. As shown, method 1400 includes receiving 1402, over a plurality of consecutive signaling intervals, a plurality of codewords, each codeword received as a plurality of symbols via wires of a multi-wire bus, the plurality of symbols received at a plurality of multi-input comparators (MICs), wherein each symbol is received by at least two MICs. At 1404, a corresponding linear combination is generated for the received symbols of each codeword. A plurality of composite skew measurement signals is generated 1406 over the plurality of consecutive signaling intervals, each composite skew measurement signal based on samples of one or more linear combinations, and wire-specific skew values of the wires of the multi-wire bus are updated 1408, wherein one or more wire-specific skew values are updated according to composite skew measurement signals associated with linear combinations formed by at least two different MICs.

[0109] In some embodiments, at least one of the plurality of composite skew measurement signals corresponds to a measurement made on a single MIC, such a skew measurement signal including skew components from all wires connected to said MIC. Embodiments updating the wire-specific delay elements using a composite skew measurement signal formed from a single MIC output are given in [Hormati II] In such embodiments, the composite skew measurement signals correspond to eye measurements made by sampling the linear combination of the MIC against variable vertical thresholds and determining if the effective eye opening of the MIC increases or decreases when wires are skewed forwards and backwards (i.e., causing signals on the wires to be relatively delayed or advanced). In some embodiments, at least one of the plurality of composite skew measurement signals is generated based on linear combinations generated by at least two MICs, including skew components of all wires associated with said at least two MICs. The skew correction circuit of FIG. 4 is such an embodiment combining two or more MIC outputs.

[0110] In some embodiments, updating a wire-specific skew value of a given wire includes adjusting a capacitance associated with the given wire. In some embodiments, adjusting the capacitance comprises controlling a switched-capacitor network connected to the given wire. FIG. 5 illustrates an exemplary wire-specific delay element in which bits are used to selectably connect capacitances to the wire to adjust a delay value. In some embodiments, CO, Cl, and C2 have equal capacitances and a thermometer code is used to control the capacitor, while alternatively CO, Cl, and C2 may be different capacitances and B0-B2 may be configured to select eight different combinations of capacitors CO, Cl, and C2. Additional or fewer capacitive elements may be included in such a circuit, three should not be considered limiting. In some embodiments, the samples of the one or more linear combinations are compared against a pre determined offset voltage using a two-input comparator, and the composite skew measurement signal represents an early-late indication signal.

[0111] In some embodiments, the wire-specific skew values are updated in response to determining a valid codeword sequence. In such embodiments, the wire-specific skew values of the wires of the multi-wire bus may include updating wires associated with the valid codeword sequence. In some embodiments, a wire-specific skew value of a given wire is updated in response to a subset of the composite skew measurement signals generated over the plurality of consecutive unit intervals exceeding an action threshold.

[0112] In some embodiments, each linear combination is performed by a corresponding MIC of the plurality of MICs, the corresponding MIC implementing a linear combination defined by a respective sub-channel vector of a plurality of mutually orthogonal sub-channel vectors.

APPENDIX I

// VerilogA for sk, x_skewrec_avg, veriloga

^' include "constants. vams"

^' include "disciplines. vams" module x_skewrec_avg(dm1 , dO, cdrearly, cdrlate, elk, to, t1 , t2, t3, vdda, vssa);

electrical [2:0] dm1 ;

input [2:0] dm1 ;

electrical [2:0] dO;

input [2:0] dO;

electrical [2:0] cdrearly;

input [2:0] cdrearly;

electrical [2:0] cdrlate;

input [2:0] cdrlate;

electrical elk;

input elk;

electrical to, t1 ,t2, t3; // outputs to control skew elements

output tO, t1 , t2, t3;

electrical vdda, vssa;

inout vdda, vssa; real tOi, t1 i, t2i, t3i, vth, vote, tavgjncdecval;

integer idO, idm1 ;

analog begin

vth = V(vdda, vssa) / 2.0; // digital slicer level for the votes

@(initial_step) begin // just set the value to default (like a reset) at beginning of simulation tOi = 0.0;

t1 i = 0.0;

t2i = 0.0;

t3i = 0.0;

end

// for every clock cycle we update the skew values; this can be dutycycled as the drift is slow in mission mode. @(cross(V(clk,vssa),1)) begin

// Actual bits from the three bits

idO = (V(d0[0], vssa) > vth) « 2 | (V(d0[1 ], vssa) > vth) « 1 | (V(d0[2], vssa) > vth) «

// History bits D(n-1) across the three sub-channels

idm1 = (V(dm1 [0], vssa) > vth) « 2 | (V(dm1 [1], vssa) > vth) « 1 | (V(dm1 [2], vssa) > vth) « 0;

// increment/decrement value, defines time constant

incdecval = 0.001 p/10;

// collect all the votes across sub-channels. Two sub-channels are always toggling, one sub-channel is static and should not contribute to votes (some embodiments enforce to ignore the static channel.)

vote = 0.0;

if(V(cdrearly[0],vssa) > vth) vote = vote + incdecval;

else vote = vote - incdecval; if(V(cdrlate[0],vssa) > vth) vote = vote - incdecval;

else vote = vote + incdecval; if(V(cdrearly[1 ],vssa) > vth) vote = vote + incdecval;

else vote = vote - incdecval; if(V(cdrlate[1 ],vssa) > vth) vote = vote - incdecval;

else vote = vote + incdecval; if(V(cdrearly[2],vssa) > vth) vote = vote + incdecval;

else vote = vote - incdecval; if(V(cdrlate[2],vssa) > vth) vote = vote - incdecval;

else vote = vote + incdecval; vote = -vote; // looking for patterns where the 1 moves from one wire to an other one. -> idO != idm1 has not been explicit defined but it is implicit as for this the votes are zero sum (some embodiments add this statement for robustness).

if((id0 == 7 | | idO == 1 || idO == 2 || idO == 4) && (idm1 == 7 || idm1 == 1 || idm1 == 2 || idm1 == 4)) begin

case (idO) // update where the 1 has ended up

7: tOi = tOi + vote;

1 : t1 i = t1 i + vote;

2: t2i = t2i + vote;

4: t3i = t3i + vote;

default: idO = idO; // fake assignment

endcase case (idm1) // update where the 1 initially was

7: tOi = tOi + vote;

1 : t1 i = t1 i + vote;

2: t2i = t2i + vote;

4: t3i = t3i + vote;

default: idm1 = idm1 ;// fake assignment

endcase

// looking for patterns where the -1 moves from one wire to an other one. -> idO != idm1 has not been explicit defined but it is implicit as for this the votes are zero sum (some embodiments add this statement for robustness).

if((id0 == 0 | | idO == 6 || idO == 5 || idO == 3) && (idm1 == 0 || idm1 == 6 || idm1 == 5 || idm1 == 3)) begin

case (idO) // update where the -1 has ended up

0: tOi = tOi + vote;

6: t1 i = t1 i + vote;

5: t2i = t2i + vote;

3: t3i = t3i + vote;

default: idO = idO; // fake assignment

endcase case (idm1) // update where the -1 initially was

0: tOi = tOi + vote;

6: t1 i = t1 i + vote; 5: t2i = t2i + vote;

3: t3i = t3i + vote;

default: idm1 = idm1 ; // fake assignment

endcase

end

// figuring out the absolute value

tavg = ( tOi + t1 i + t2i + t3i ) / 4;

// and subtraction it (enforcing it to zero)

tOi = tOi - tavg;

t1 i = t1 i - tavg;

t2i = t2i - tavg;

t3i = t3i - tavg;

11 saturation logic

if(t0i > 12.5p) tOi = 12.5p;

if(t0i < -12.5p) tOi = -12.5p; if(t1 i > 12.5p) t1 i = 12.5p;

if (t 1 i < -12.5p) t1 i = -12.5p; if(t2i > 12.5p) t2i = 12.5p;

if(t2i < -12.5p) t2i = -12.5p; if(t3i > 12.5p) t3i = 12.5p;

if(t3i < -12.5p) t3i = -12.5p; end // end of the cross function resp. elk

// assignment to the output. Will be fed into veriloga skew elements (e.g. absdelay is used shift/delay the signal in time)

V(t0, vssa) <+ Iaplace_nd(t0i + 12.5p + 5p, {1 , 0}, {1 , 2e-12});

V(t1 , vssa) <+ Iaplace_nd(t1 i + 12.5p + 5p, {1 , 0}, {1 , 2e-12});

V(t2, vssa) <+ Iaplace_nd(t2i + 12.5p + 5p, {1 , 0}, {1 , 2e-12});

V(t3, vssa) <+ Iaplace_nd(t3i + 12.5p + 5p, {1 , 0}, {1 , 2e-12}); end endmodule