Yttrium tungstate precursors with novel 3D hierarchical architectures assembled from nanosheet building blocks were successfully synthesized by a hydrothermal method with the assistance of sodium dodecyl benzenesulfonate (SDBS). After calcination, the precursors were easily converted to Y2(WO4)3 without an obvious change in morphology. The as-prepared precursors and Y2(WO4)3 were characterized by means of X-ray diffraction (XRD), scanning electron microscopy (SEM), transmission electron microscopy (TEM), and high-resolution transmission electron microscopy (HRTEM), and photoluminescence (PL) spectra, respectively. The results reveal that the morphology and dimensions of the as-prepared precursors can be effectively tuned by altering the amounts of organic SDBS and the reaction time, and the possible formation mechanism was also proposed. Upon ultraviolet (UV) excitation, the emission of Y2(WO4)3:x mol% Eu3+ microcrystals can be tuned from white to red, and the doping concentration of Eu3+ has been optimized. Furthermore, the up-conversion (UC) luminescence properties as well as the emission mechanisms of Y2(WO4)3:Yb3+/Ln3+ (Ln = Er, Tm, Ho) microcrystals were systematically investigated, which show green (Er3+, 4S3/2, 2H11/2 → 4I15/2), blue (Tm3+, 1G4 → 3H6) and yellow (Ho3+, 5S2 → 5I8) luminescence under 980 nm NIR excitation. Moreover, the doping concentration of the Yb3+ has been optimized under a fixed concentration of Er3+ for the UC emission of Y2(WO4)3:Yb3+/Er3+.