Bacterial polysaccharides are comprised of a variety of monosaccharides, L-rhamnose (6-deoxy-L-mannose) being one of them. This sugar is often part of α-(1 → 2)- and/or α-(1 → 3)-linkages and we have therefore studied the disaccharide α-L-Rhap-(1 → 2)-α-L-Rhap-OMe to obtain information on conformational preferences at this glycosidic linkage. The target disaccharide was synthesized with 13C site-specific labeling at C1′ and at C2′, i.e., in the terminal group. 2D 1H,13C-HSQC-HECADE and 1H,13C-J-HMBC NMR experiments, 1D 13C and 1H NMR spectra together with total line-shape analysis were used to extract conformationally dependent hetero- and homonuclear spin–spin coupling constants. This resulted in the determination of 2JC2′,H1′, 3JC1′,C1, 3JC1′,C3, 3JC2′,C2, 2JC1′,C2, 1JC1′,C2′, and 1JC1′,H1′. These data together with previously determined JCH and 1H,1H NOEs result in fourteen conformationally dependent NMR parameters that are available for analysis of glycosidic linkage flexibility and conformational preferences. A 100 ns molecular dynamics (MD) simulation of the disaccharide with explicit water molecules as solvent showed a major conformational state at ϕH ≈ 40° and ψH ≈ −35°, consistent with experimental NMR data. In addition, MD simulations were carried out also for α-L-Rhap-(1 → 3)-α-L-Rhap-OMe and a rhamnan hexasaccharide. The gathered information on the oligosaccharides was used to address conformational preferences for a larger structure, a 2- and 3-linked nonasaccharide, with implications for the 3D structure of rhamnan polysaccharides, which should be regarded as flexible polymers.