D. Arnold, and H. Loeliger, “On the information rate of binary-input channels with memory,” Proc. ICC’2001, pp. 2692–2695 (2001).

T. Cover, and J. Thomas, Elements of Information Theory, John Wiley & Sons, New York (1991).

R. G. Gallager, Information Theory and Reliable Communication, John Wiley & Sons, New York (1968).

J. G. Proakis, Digital Communications, 4th Edition, McGraw-Hill, New York (2001).

Y. Cai, “Performance limits of FEC and modulation formats in optical fiber communications,” Proc. LEOS’06, paper WH1 (2006).

Y. Cai, D. Foursa, C. R. Davidson, J.-X. Cai, O. Sinkin, M. Nissov, and A. Pilipetskii, “Experimental demonstration of coherent MAP detection for nonlinearity mitigation in long-haul transmissions,” Proc. OFC/NFOEC’10, paper OTuE1 (2010).

M. Salsi, H. Mardoyan, P. Tran, C. Koebele, E. Dutisseuil, G. Charlet, and S. Bigo, “155x100Gbit/s coherent PDM-QPSK transmission over 7,200km,” Proc. ECOC’09, paper PD2.5 (2009).

A. Sano, H. Masuda, T. Kobayashi, M. Fujiwara, K. Horikoshi, E. Yoshida, Y. Miyamoto, M. Matsui, M. Mizoguchi, H. Yamazaki, Y. Sakamaki, and H. Ishii, “69.1-Tb/s (432x171-Gb/s) C- and extended L-band transmission over 240 km using PDM-16-QAM modulation and digital coherent detection,” Proc. OFC/NFOEC’10, paper PDPB7 (2010).

X. Zhou, J. Yu, M. Huang, Y. Shao, T. Wang, L. Nelson, P. Magill, M. Birk, P. I. Borel, D. W. Peckham, and R. Lingle, Jr., “64-Tb/s (640x107-Gb/s) PDM-36QAM transmission over 320km using both pre- and post-transmission digital equalization,” Proc. OFC/NFOEC’10, paper PDPB9 (2010).

X. Liu, S. Chandrasekhar, B. Chu, P. J. Winzer, A. H. Gnauck, and D. W. Peckham, “Transmission of a 448-Gb/s reduced-guard-interval CO-OFDM signal with a 60-GHz optical bandwidth over 2000 km of ULAF and five 80-GHz-Grid ROADMs,” Proc. OFC/NFOEC’10, paper PDPC2 (2010).

M. Rubsamen, P. J. Winzer, and R.-J. Essiambre, “MLSE receivers for narrow-band optical filtering,” Proc. OFC/NFOEC‘06, paper OWB6 (2006).

N. Alic, E. Myslivets, and S. Radic, “1.0 bit/s/Hz spectral efficiency in single polarization at 2000km with narrowly filtered intensity modulated signals,” Proc. IEEE Summer Topical Meeting 2008, paper TuD3.4 (2008).

J. X. Cai, Y. Cai, C. R. Davidson, D. Foursa, A. Lucero, O. Sinkin, A. Pilipetskii, G. Mohs, and S. Neal Bergano, “Transmission of 96x100G pre-filtered PDM-RZ-QPSK channels with 300% spectral efficiency over 10,608km and 400% spectral efficiency over 4,368km,” Proc. OFC/NFOEC’10, paper PDPB10 (2010).

Y. Cai, J. X. Cai, C. R. Davidson, D. Foursa, A. Lucero, O. Sinkin, A. Pilipetskii, G. Mohs, and S. Neal Bergano, “High spectral efficiency long-Haul transmission with pre-filtering and maximum a posteriori probability detection,” Proc. ECOC’2010, paper We.7.C.4 (2010).

Y. Cai, N. Ramanujam, J. M. Morris, T. Adali, G. Lenner, A. B. Puc, and A. Pilipetskii, “Performance limit of forward error correction codes in optical fiber communications,” Proc. OFC/IOOC’01, paper TuF2 (2001).