{"id":5225,"date":"2020-09-09T11:17:09","date_gmt":"2020-09-09T02:17:09","guid":{"rendered":"https:\/\/sasamath.com\/blog\/?p=5225"},"modified":"2021-06-10T13:33:12","modified_gmt":"2021-06-10T04:33:12","slug":"exercises-inner-product-spaces","status":"publish","type":"post","link":"https:\/\/sasamath.com\/blog\/articles\/exercises-inner-product-spaces\/","title":{"rendered":"Exercises: Inner Product Spaces"},"content":{"rendered":"<div class=\"box\">\n<p>This set of exercises is retrieved from the seventh chapter of Linear Algebra by Robert J. Valenza. Note that these solutions are not fully elaborated; You have to fill the descriptions by yourself.\n<\/p>\n<\/div>\n<p><!-- ########## ########## ########## --><\/p>\n<p class=\"problem\"><span class=\"definition\">Problem 7.1<\/span><br \/>\nIn \\(\\mathbb{R}^3,\\) compute the inner product of \\((1,\\,2,\\,-1)\\) and \\((2,\\,1,\\,4).\\) What is the length of each vector? What is the angle between these vectors?\n<\/p>\n<div class=\"solution\">\n<p><span class=\"proof\">Solution.<\/span><br \/>\nThe lengths of given vectors are<br \/>\n\\[\\begin{aligned}<br \/>\n\\lVert (1,\\,2,\\,-1)\\rVert &#038;= \\sqrt{1^2 + 2^2 + (-1)^2} = \\sqrt{6} ,\\\\[4pt]<br \/>\n\\lVert (2,\\,1,\\,4)\\rVert &#038;= \\sqrt{2^2 +1^2 +4^2} = \\sqrt{21} .<br \/>\n\\end{aligned}\\]<br \/>\nLet \\(\\theta\\) be the angle between two vectors. Since<br \/>\n\\[\\langle (1,\\,2,\\,-1) \\,\\vert\\, (2,\\,1,\\,4)\\rangle = 2+2-4 = 0,\\]<br \/>\nwe have<br \/>\n\\[\\cos\\theta = \\frac{0}{\\sqrt{6} \\sqrt{21}} = 0,\\]<br \/>\nthat is, two vectors are orthogonal.\n<\/p>\n<\/div>\n<p><!-- ########## ########## ########## --><\/p>\n<p class=\"problem\"><span class=\"definition\">Problem 7.2<\/span><br \/>\nWhat is the angle between the vectors \\((1,\\,2,\\,4)\\) and \\((2,\\,5,\\,1)\\) in \\(\\mathbb{R}^3?\\) You may leave your answer in terms of the inverse cosine function.\n<\/p>\n<div class=\"solution\">\n<p><span class=\"proof\">Solution.<\/span><br \/>\nLet \\(\\theta\\) be the angle between two vectors.<br \/>\n\\[\\begin{aligned}<br \/>\n\\cos\\theta<br \/>\n&#038;= \\frac{\\langle (1,\\,2,\\,4) \\,\\vert\\, (2,\\,5,\\,1)\\rangle}{\\lVert (1,\\,2,\\,4)\\rVert \\lVert (2,\\,5,\\,-1)\\rVert} \\\\[4pt]<br \/>\n&#038;= \\frac{16}{\\sqrt{21}\\sqrt{30}} = \\frac{16}{3\\sqrt{70}}.<br \/>\n\\end{aligned}\\]<br \/>\nHence<br \/>\n\\[\\theta = \\cos^{-1} \\frac{16}{3\\sqrt{70}} \\approx 0.8796 \\,(\\approx 50.4 ^\\circ ) \\]\n<\/p>\n<\/div>\n<p><!-- ########## ########## ########## --><\/p>\n<p class=\"problem\"><span class=\"definition\">Problem 7.3<\/span><br \/>\nFind all vectors in \\(\\mathbb{R}^3\\) which are orthogonal to both of the following vectors:<br \/>\n\\[(1,\\,2,\\,0) \\,\\,\\text{and}\\,\\, (1,\\,0,\\,1).\\]<br \/>\nThis amounts to a homogeneous system of two equations in three unknowns.\n<\/p>\n<div class=\"solution\">\n<p><span class=\"proof\">Solution.<\/span><br \/>\nSince<br \/>\n\\[(1,\\,2,\\,0)\\times (1,\\,0,\\,1) = (2,\\,-1,\\,-2),\\]<br \/>\nthe desired vector is<br \/>\n\\[k(2,\\,-1,\\,-2)\\]<br \/>\nwhere \\(k\\) is any real number.\n<\/p>\n<\/div>\n<p><!-- ########## ########## ########## --><\/p>\n<p class=\"problem\"><span class=\"definition\">Problem 7.4<\/span><br \/>\nCompute the inner product \\(\\langle f\\,\\vert\\, g\\rangle\\) in \\(C^0 ( [ -\\pi ,\\, \\pi ] )\\) for the following functions:<br \/>\n\\[f(x)=2x \\,\\,\\,\\text{and}\\,\\,\\, g(x)=\\sin x.\\]\n<\/p>\n<div class=\"solution\">\n<p><span class=\"proof\">Solution.<\/span><br \/>\n\\[\\langle f\\,\\vert\\,g\\rangle = \\int_{-\\pi}^{\\pi} 2x \\sin x\\, dx = 4\\pi .\\]\n<\/p>\n<\/div>\n<p><!-- ########## ########## ########## --><\/p>\n<p class=\"problem\"><span class=\"definition\">Problem 7.5<\/span><br \/>\nIn the context of the previous problem, find the length of the functions \\(f\\) and \\(g.\\) What is the angle between these functions? Interpret the Cauchy-Schwarz Inequality in this special case.\n<\/p>\n<div class=\"solution\">\n<p><span class=\"proof\">Solution.<\/span><br \/>\n\\[\\begin{aligned}<br \/>\n\\langle f\\,\\vert\\,f\\rangle &#038;= \\int_{-\\pi}^{\\pi} 2x\\cdot 2x \\,dx = \\frac{8}{3} \\pi^3 , \\\\[4pt]<br \/>\n\\lVert f\\rVert &#038;= \\sqrt{\\frac{8}{3}\\pi^3} ,\\\\[4pt]<br \/>\n\\langle g\\,\\vert\\,g\\rangle &#038;= \\int_{-\\pi}^{\\pi} \\sin x \\cdot \\sin x \\,dx = \\pi ,\\\\[4pt]<br \/>\n\\lVert g \\rVert &#038;= \\sqrt{\\pi} .<br \/>\n\\end{aligned}\\]<br \/>\nLet \\(\\theta\\) be the angle between \\(f\\) and \\(g.\\)<br \/>\n\\[\\cos\\theta<br \/>\n= \\frac{\\langle f\\,\\vert\\,g\\rangle}{\\lVert f \\rVert \\lVert g \\rVert}<br \/>\n= \\frac{4\\pi}{\\sqrt{\\frac{8}{3}\\pi^3}\\sqrt{\\pi}} = \\frac{\\sqrt{6}}{\\pi}.\\]<br \/>\nHence we have<br \/>\n\\[\\langle f\\,\\vert\\,g\\rangle = 4\\pi \\le \\sqrt{\\frac{8}{3}}\\pi^2 = \\lVert f \\rVert \\lVert g\\rVert,\\]<br \/>\nand we see that Cauchy-Schwarz inequality holds.\n<\/p>\n<\/div>\n<p><!-- ########## ########## ########## --><\/p>\n<p class=\"problem\"><span class=\"definition\">Problem 7.6<\/span><br \/>\nIn the inner product space \\(C^0 ( [-1 ,\\, +1]),\\) for which \\(n\\) are the monomials \\(x^n\\) orthogonal to the constant function \\(1?\\)\n<\/p>\n<div class=\"solution\">\n<p><span class=\"proof\">Solution.<\/span><br \/>\nSince<br \/>\n\\[\\langle 1\\,\\vert\\,x^n \\rangle = \\int_{-1}^{1} 1\\cdot x^n \\,dx = \\frac{1+(-1)^n}{n+1},\\]<br \/>\n\\(1\\) and \\(x^n\\) are orthogonal to each other if and only if \\(n\\) is an odd number.\n<\/p>\n<\/div>\n<p><!-- ########## ########## ########## --><\/p>\n<p class=\"problem\"><span class=\"definition\">Problem 7.7<\/span><br \/>\nIn the context of the previous problem, what is the length of each of the monomials \\(x^n ?\\)\n<\/p>\n<div class=\"solution\">\n<p><span class=\"proof\">Solution.<\/span><br \/>\n\\[\\lVert x^n \\rVert = \\sqrt{\\langle x^n \\,\\vert\\, x^n \\rangle}= \\sqrt{\\frac{2}{2n+1}}.\\]\n<\/p>\n<\/div>\n<p><!-- ########## ########## ########## --><\/p>\n<p class=\"problem\"><span class=\"definition\">Problem 7.8<\/span><br \/>\nUse the Cauchy-Schwarz Inequality on the appropriate inner product space to bound the definite integral<br \/>\n\\[\\int_{0}^{\\pi\/2} \\sqrt{x\\sin x} \\,dx .\\]\n<\/p>\n<div class=\"solution\">\n<p><span class=\"proof\">Solution.<\/span><br \/>\nTake \\(\\sqrt{x}\\) and \\(\\sqrt{\\sin x}\\) in \\(C^0 ( [ 0 ,\\, \\frac{\\pi}{2} ] ) .\\) Then, by Cauchy-Schwarz inequality, we have<br \/>\n\\[\\begin{aligned}<br \/>\n\\int_{0}^{\\pi \/2} \\sqrt{x}\\sqrt{\\sin x} \\,dx<br \/>\n&#038;= \\left\\langle \\sqrt{x} \\,\\vert\\, \\sqrt{\\sin x}\\right\\rangle \\\\[4pt]<br \/>\n&#038;\\le \\left\\lVert \\sqrt{x} \\right\\rVert \\left\\lVert \\sqrt{\\sin x} \\right\\rVert \\\\[4pt]<br \/>\n&#038;= \\sqrt{\\int_{0}^{\\pi \/2} x \\,dx} \\cdot \\sqrt{\\int_0^{\\pi \/2} \\sin x\\,dx} \\\\[4pt]<br \/>\n&#038;= \\sqrt{\\frac{\\pi^2}{8}} \\cdot \\sqrt{1} = \\frac{\\pi}{2\\sqrt{2}}.<br \/>\n\\end{aligned}\\]<br \/>\nIn fact,<br \/>\n\\[\\begin{aligned}<br \/>\n\\int_{0}^{\\pi\/2} \\sqrt{x\\sin x}\\,dx &#038;\\approx 1.10839 ,\\\\[4pt]<br \/>\n\\frac{\\pi}{2\\sqrt{2}} &#038; \\approx 1.11072 .<br \/>\n\\end{aligned}\\]\n<\/p>\n<\/div>\n<p><!-- ########## ########## ########## --><\/p>\n<p class=\"problem\"><span class=\"definition\">Problem 7.9<\/span><br \/>\nProve that in an \\(n\\)-dimensional inner product space an orthogonal family may contain at most \\(n\\) vectors.\n<\/p>\n<div class=\"solution\">\n<p><span class=\"proof\">Solution.<\/span><br \/>\nAn orthogonal family is linearly independent. An \\(n\\)-dimensional space cannot contain a linearly independent family of more than \\(n\\) vectors.\n<\/p>\n<\/div>\n<p><!-- ########## ########## ########## --><\/p>\n<p class=\"problem\"><span class=\"definition\">Problem 7.10<\/span><br \/>\nCarry on the Gram-Schmidt orthonormalization process on the following pair of vectors in \\(\\mathbb{R}^2\\) to obtain an orthonormal basis:<br \/>\n\\[v_1=(2,\\,1) \\,\\,\\text{and}\\,\\,v_2=(-1,\\,3).\\]\n<\/p>\n<div class=\"solution\">\n<p><span class=\"proof\">Solution.<\/span><br \/>\nFirst, normalize \\(v_1 :\\)<br \/>\n\\[\\begin{aligned}<br \/>\n\\lVert v_1 \\rVert<br \/>\n&#038;= \\sqrt{2^2 +1^2} = \\sqrt{5}, \\\\[4pt]<br \/>\nu_1 &#038;= \\frac{1}{\\sqrt{5}} (2,\\,1) = \\left(\\frac{2}{\\sqrt{5}} ,\\, \\frac{1}{\\sqrt{5}}\\right).<br \/>\n\\end{aligned}\\]<br \/>\nSecond, find \\(u_2 :\\)<br \/>\n\\[\\begin{aligned}<br \/>\nv_2 &#8211; \\operatorname{proj}_{v_1} v_2<br \/>\n&#038;= (-1,\\,3) &#8211; \\frac{(2,\\,1) \\cdot (-1,\\,3)}{(2,\\,1)\\cdot (2,\\,1)} (2,\\,1) \\\\[4pt]<br \/>\n&#038;= (-1,\\,3) &#8211; \\frac{1}{5} (2,\\,1) \\\\[4pt]<br \/>\n&#038;= \\left( &#8211; \\frac{7}{5} ,\\, \\frac{14}{5}\\right), \\\\[4pt]<br \/>\n\\left\\lvert\\left(-\\frac{7}{5} ,\\, \\frac{14}{5}\\right)\\right\\rvert &#038;= \\frac{7}{\\sqrt{5}} ,\\\\[4pt]<br \/>\nu_2 &#038;= \\frac{\\sqrt{5}}{7}\\left(-\\frac{7}{5} ,\\, \\frac{14}{5}\\right) \\\\[4pt]<br \/>\n&#038;= \\left(-\\frac{1}{\\sqrt{5}},\\, \\frac{2}{\\sqrt{5}}\\right).<br \/>\n\\end{aligned}\\]<br \/>\nNow \\(u_1,\\) \\(u_2\\) constitute an orthonormal basis for \\(\\mathbb{R}^2.\\)\n<\/p>\n<\/div>\n<p><!-- ########## ########## ########## --><\/p>\n<p class=\"problem\"><span class=\"definition\">Problem 7.11<\/span><br \/>\nApply the Gram-Schmidt orthonormalization process to the vectors<br \/>\n\\[v_1=(3,\\,4,\\,5) \\,\\,\\, \\text{and} \\,\\,\\, v_2=(1,\\,0,\\,1)\\]<br \/>\nto obtain an orthonormal pair of vectors with the same span.\n<\/p>\n<div class=\"solution\">\n<p><span class=\"proof\">Solution.<\/span><br \/>\nFirst, normalize \\(v_1\\):<br \/>\n\\[\\begin{aligned}<br \/>\n\\lVert v_1 \\rVert<br \/>\n&#038;= \\sqrt{9+16+25} = 5\\sqrt{2} ,\\\\[4pt]<br \/>\nu_1 &#038;= \\frac{1}{5\\sqrt{2}}v_1 = \\frac{1}{5\\sqrt{2}}(3,\\,4,\\,5)\\\\[4pt]<br \/>\n&#038;= \\left( \\frac{3}{5\\sqrt{2}} ,\\, \\frac{4}{5\\sqrt{2}} ,\\, \\frac{1}{\\sqrt{2}}\\right).<br \/>\n\\end{aligned}\\]<br \/>\nNext, find \\(u_2\\):<br \/>\n\\[\\begin{aligned}<br \/>\n v_2 &#8211; \\operatorname{proj}_{v_1} v_2<br \/>\n&#038;= (1,\\,0,\\,1) &#8211; \\frac{8}{50} (3,\\,4,\\,5) \\\\[4pt]<br \/>\n&#038;= (1,\\,0,\\,1) &#8211; \\left( \\frac{24}{50} ,\\, \\frac{32}{50} ,\\, \\frac{40}{50}\\right) \\\\[4pt]<br \/>\n&#038;= \\left( \\frac{13}{25} ,\\, -\\frac{16}{25} ,\\, \\frac{1}{5}\\right), \\\\[4pt]<br \/>\n\\left\\lVert \\left( \\frac{13}{25} ,\\, -\\frac{16}{25} ,\\, \\frac{1}{5}\\right) \\right\\rVert<br \/>\n&#038;= \\frac{1}{25}\\sqrt{169+256+25}\\\\[4pt]<br \/>\n&#038;= \\frac{\\sqrt{450}}{25} = \\frac{3\\sqrt{2}}{5},\\\\[4pt]<br \/>\nu_2 &#038;= \\frac{5}{3\\sqrt{2}} \\left(\\frac{13}{25} ,\\, -\\frac{16}{25} ,\\, \\frac{1}{5}\\right) \\\\[4pt]<br \/>\n&#038;= \\left( \\frac{13}{15\\sqrt{2}} ,\\, -\\frac{16}{15\\sqrt{2}} ,\\, \\frac{1}{3\\sqrt{2}} \\right).<br \/>\n\\end{aligned}\\]<br \/>\nCheckup:<br \/>\n\\[u_1 \\cdot u_2 = \\frac{39}{150} &#8211; \\frac{64}{150} + \\frac{1}{6} = 0.\\]\n<\/p>\n<\/div>\n<p><!-- ########## ########## ########## --><\/p>\n<p class=\"problem\"><span class=\"definition\">Problem 7.12<\/span><br \/>\nLet \\(V=\\mathbb{R}^3\\) and let \\(W\\) be the subspace of \\(V\\) spanned by the vectors \\((1,\\,0,\\,1)\\) and \\((0,\\,1,\\,0).\\) What point of \\(W\\) is closest to the vector \\((6,\\,2,\\,5)?\\)\n<\/p>\n<div class=\"solution\">\n<p><span class=\"proof\">Solution.<\/span><br \/>\nLet<br \/>\n\\[\\begin{aligned}<br \/>\nw_1 &#038;= (1,\\,0,\\,1), \\\\[4pt]<br \/>\nw_2 &#038;= (0,\\,1,\\,0), \\\\[4pt]<br \/>\nW &#038;= \\operatorname{Span}(w_1 ,\\,w_2 ),\\\\[4pt]<br \/>\nv &#038;= (6,\\,2,\\,5).<br \/>\n\\end{aligned}\\]<br \/>\nSince \\(w_1 \\bot w_2,\\) the projection of \\(v\\) onto \\(W\\) is as follows.<br \/>\n\\[\\begin{aligned}<br \/>\n\\operatorname{proj}_{w_1} v<br \/>\n&#038;= \\frac{w_1 \\cdot v}{w_1 \\cdot w_1} w_1 = \\frac{11}{2} w_1 = \\left( \\frac{11}{2} ,\\, 0 ,\\, \\frac{11}{2}\\right) ,\\\\[4pt]<br \/>\n\\operatorname{proj}_{w_2} v<br \/>\n&#038;= \\frac{w_2 \\cdot v}{w_2 \\cdot w_2} w_2 = \\frac{2}{1} w_2 = (0,\\,2,\\,0), \\\\[4pt]<br \/>\n\\operatorname{proj}_W v<br \/>\n&#038;= \\operatorname{proj}_{W_1} v + \\operatorname{proj}_{W_2} v<br \/>\n=\\left( \\frac{11}{2} ,\\,2,\\, \\frac{11}{2}\\right).<br \/>\n\\end{aligned}\\]<br \/>\nHence \\((\\frac{11}{2} ,\\,2,\\,\\frac{11}{2})\\) is the closest vector.\n<\/p>\n<\/div>\n<p><!-- ########## ########## ########## --><\/p>\n<p class=\"problem\"><span class=\"definition\">Problem 7.13<\/span><br \/>\nIn \\(\\mathbb{R}^3,\\) let \\(W\\) be the subspace spanned by the vectors \\((1,\\,1,\\,2)\\) and \\((1,\\,1,\\,-1).\\) What point of \\(W\\) is closest to the vector \\((4,\\,5,\\,-2)?\\)\n<\/p>\n<div class=\"solution\">\n<p><span class=\"proof\">Solution.<\/span><br \/>\nLet<br \/>\n\\[\\begin{aligned}<br \/>\nw_1 &#038;= (1,\\,1,\\,2),\\\\[4pt]<br \/>\nw_2 &#038;= (1,\\,1,\\,-1),\\\\[4pt]<br \/>\nW &#038;= \\operatorname{Span}(w_1,\\,w_2),\\\\[4pt]\\<br \/>\nv &#038;= (4,\\,5,\\,-2).<br \/>\n\\end{aligned}\\]<br \/>\nSince \\(w_1 \\bot w_2,\\) the projection of \\(v\\) onto \\(W\\) is as follows.<br \/>\n\\[\\begin{aligned}<br \/>\n\\operatorname{proj}_{w_1}v &#038;= \\frac{w_1 \\cdot v}{w_1 \\cdot w_1} w_1 = \\frac{5}{6}(1,\\,1,\\,2) = \\left( \\frac{5}{6} ,\\, \\frac{5}{6} ,\\, \\frac{10}{6}\\right),\\\\[4pt]<br \/>\n\\operatorname{proj}_{w_2}v &#038;= \\frac{w_2 \\cdot v}{w_2 \\cdot w_2} w_2 = \\frac{11}{3} (1,\\,1,\\,-1) = \\left(\\frac{11}{3} ,\\, \\frac{11}{3} ,\\, -\\frac{11}{3}\\right),\\\\[4pt]<br \/>\n\\operatorname{proj}_{W}v &#038;= \\operatorname{proj}_{w_1}v+\\operatorname{proj}_{w_2}v \\\\[4pt]<br \/>\n&#038;= \\left(\\frac{27}{6} ,\\, \\frac{27}{6} ,\\, -\\frac{6}{3}\\right) = \\left( \\frac{9}{2} ,\\,\\frac{9}{2} ,\\, -2 \\right).<br \/>\n\\end{aligned}\\]<br \/>\nHence \\((\\frac{9}{2} ,\\, \\frac{9}{2} ,\\, -2)\\) is the closest vector.\n<\/p>\n<\/div>\n<p><!-- ########## ########## ########## --><\/p>\n<p class=\"problem\"><span class=\"definition\">Problem 7.14<\/span><br \/>\nIn \\(\\mathbb{R}^3,\\) find the orthogonal projection of \\((2,\\,2,\\,5)\\) on the subspace spanned by the vectors \\((2,\\,1,\\,1)\\) and \\((0,\\,2,\\,1).\\)\n<\/p>\n<div class=\"solution\">\n<p><span class=\"proof\">Solution.<\/span><br \/>\nLet<br \/>\n\\[\\begin{aligned}<br \/>\nv_1 &#038;= (2,\\,1,\\,1),\\\\[4pt]<br \/>\nv_2 &#038;= (0,\\,2,\\,1),\\\\[4pt]<br \/>\nv   &#038;= (2,\\,2,\\,5),\\\\[4pt]<br \/>\nW   &#038;= \\operatorname{Span}(v_1 ,\\,v_2 ).<br \/>\n\\end{aligned}\\]<br \/>\nSince \\(v_1\\) and \\(v_2\\) are not orthogonal to each other, we have to find an orthogonal basis for \\(W.\\) The Gram-Schmidt orthogonalization gives us the following:<br \/>\n\\[\\begin{aligned}<br \/>\n\\lVert v_1 \\rVert &#038;= \\sqrt{6} ,\\\\[4pt]<br \/>\nu_1 &#038;= \\frac{1}{\\sqrt{6}}(2,\\,1,\\,1), \\\\[4pt]<br \/>\nv_2 &#8211; \\operatorname{proj}_{v_1}v_2 &#038;= (0,\\,2,\\,1) &#8211; \\left( 1,\\,\\frac{1}{2} ,\\, \\frac{1}{2}\\right) = \\left( -1 ,\\, \\frac{3}{2} ,\\, \\frac{1}{2}\\right) ,\\\\[4pt]<br \/>\n\\left\\lVert \\left( -1 ,\\, \\frac{3}{2} ,\\, \\frac{1}{2}\\right) \\right\\rVert<br \/>\n&#038;= \\sqrt{1+\\frac{9}{4} + \\frac{1}{4}} = \\sqrt{\\frac{14}{4}} = \\frac{\\sqrt{14}}{2},\\\\[4pt]<br \/>\nu_2 &#038;= \\frac{2}{\\sqrt{14}}\\left(-1,\\,\\frac{3}{2} ,\\,\\frac{1}{2}\\right) = \\left(-\\frac{2}{\\sqrt{14}} ,\\, \\frac{3}{\\sqrt{14}} ,\\, \\frac{1}{\\sqrt{14}}\\right).<br \/>\n\\end{aligned}\\]<br \/>\nHence \\(u_1,\\) \\(u_2\\) constitutes an orthonormal basis for \\(W.\\)<br \/>\nNow we find the projection of \\(v\\) onto \\(W\\):<br \/>\n\\[\\begin{aligned}<br \/>\n\\operatorname{proj}_{u_1}v<br \/>\n&#038;= (u_1 \\cdot v)u_1 \\\\[4pt]<br \/>\n&#038;= \\frac{11}{6} (2,\\,1,\\,1) = \\left(\\frac{11}{3} ,\\, \\frac{11}{6} ,\\, \\frac{11}{6}\\right) ,\\\\[4pt]<br \/>\n\\operatorname{proj}_{u_2}v<br \/>\n&#038;= (u_2 \\cdot v)u_2 \\\\[4pt]<br \/>\n&#038;= 1\\left(-1,\\, \\frac{3}{2} ,\\, \\frac{1}{2}\\right) = \\left(-1,\\, \\frac{3}{2} ,\\, \\frac{1}{2}\\right),\\\\[4pt]<br \/>\n\\operatorname{proj}_{W}v<br \/>\n&#038;= \\operatorname{proj}_{u_1}v + \\operatorname{proj}_{u_2}v \\\\[4pt]<br \/>\n&#038;= \\left(\\frac{11}{3} &#8211; 1 ,\\, \\frac{11}{6} + \\frac{3}{2} ,\\, \\frac{11}{6} + \\frac{1}{2}\\right)\\\\[4pt]<br \/>\n&#038;=\\left( \\frac{8}{3},\\, \\frac{10}{3} ,\\, \\frac{7}{3}\\right).<br \/>\n\\end{aligned}\\]<br \/>\nTherefore \\(\\left( \\frac{8}{3},\\, \\frac{10}{3} ,\\, \\frac{7}{3}\\right)\\) is the closest vector.\n<\/p>\n<\/div>\n<p><!-- ########## ########## ########## --><\/p>\n<p class=\"problem\"><span class=\"definition\">Problem 7.15<\/span><br \/>\nGranting that the functions<br \/>\n\\[1,\\,\\, \\cos x,\\,\\, \\sin x,\\,\\, \\cos 2x ,\\,\\, \\sin 2x ,\\,\\, \\cdots\\]<br \/>\nconstitute an orthogonal family in \\(C^0 ([-\\pi ,\\, +\\pi ]),\\) modify each function by a scalar to convert this to an orthonormal family.\n<\/p>\n<div class=\"solution\">\n<p><span class=\"proof\">Solution.<\/span><br \/>\nKeep calm and call Calculus.<br \/>\n\\[\\begin{aligned}<br \/>\n\\int_{-\\pi}^{\\pi} 1\\,dx &#038;= 2\\pi, \\\\[4pt]<br \/>\n\\lVert 1 \\rVert  &#038;= \\sqrt{2\\pi} ,\\\\[4pt]<br \/>\n\\int_{-\\pi}^{\\pi} (\\cos nx)^2 \\,dx &#038;= \\pi ,\\\\[4pt]<br \/>\n\\lVert \\cos nx \\rVert &#038;= \\sqrt{\\pi} ,\\\\[4pt]<br \/>\n\\int_{-\\pi}^{\\pi} (\\sin nx)^2 \\,dx &#038;= \\pi ,\\\\[4pt]<br \/>\n\\lVert \\sin nx \\rVert &#038;= \\sqrt{\\pi} ,\\\\[4pt]<br \/>\n\\int_{-\\pi}^{\\pi} \\sin(mx) \\cdot \\cos(nx) \\,dx &#038;=0 \\\\[4pt]<br \/>\n\\int_{-\\pi}^{\\pi} \\sin(mx) \\cdot \\sin(nx) \\,dx &#038;=0 \\\\[4pt]<br \/>\n\\int_{-\\pi}^{\\pi} \\cos(mx) \\cdot \\cos(nx) \\,dx &#038;=0,<br \/>\n\\end{aligned}\\]<br \/>\nwhere \\(n\\) and \\(m\\) are distinct nonnegative integers.<br \/>\nHence the desired orthonormal family is<br \/>\n\\[\\frac{1}{\\sqrt{2\\pi}},\\,\\, \\frac{1}{\\sqrt{\\pi}}\\cos x ,\\,\\, \\frac{1}{\\sqrt{\\pi}}\\sin x ,\\,\\, \\frac{1}{\\sqrt{\\pi}}\\cos 2x ,\\,\\, \\frac{1}{\\sqrt{\\pi}}\\sin 2x ,\\,\\, \\cdots .\\]\n<\/p>\n<\/div>\n<p><!-- ########## ########## ########## --><\/p>\n<p class=\"problem\"><span class=\"definition\">Problem 7.16<\/span><br \/>\nLet \\(f\\in V = C^0 ([-\\pi ,\\, \\pi ]).\\) Give a formula for the orthogonal projection of \\(f\\) onto the subspace of \\(V\\) spanned by the \\(2n+1\\) functions \\(1,\\) \\(\\cos x,\\) \\(\\sin x,\\) \\(\\cos 2x ,\\) \\(\\sin 2x,\\) \\(\\cdots ,\\) \\(\\cos nx,\\) \\(\\sin nx.\\) Expand this in terms of the appropriate definite integrals, which you need not compute. (Thus begins the development of <span class=\"defined\">Fourier series<\/span>.)\n<\/p>\n<div class=\"solution\">\n<p><span class=\"proof\">Solution.<\/span><br \/>\nDefine<br \/>\n\\[\\begin{aligned}<br \/>\na_0 &#038;= \\frac{1}{\\pi} \\int_{-\\pi}^{\\pi} f(x) dx , \\\\[4pt]<br \/>\na_k &#038;= \\frac{1}{\\pi} \\int_{-\\pi}^{\\pi} f(x)\\cos(kx)\\,dx ,\\\\[4pt]<br \/>\nb_k &#038;= \\frac{1}{\\pi} \\int_{-\\pi}^{\\pi} f(x)\\sin(kx)\\,dx<br \/>\n\\end{aligned}\\]<br \/>\nfor \\(k=1,\\,2,\\,\\cdots,\\,n.\\) Then<br \/>\n\\[\\begin{aligned}<br \/>\n\\operatorname{proj}_W(f)<br \/>\n&#038;= \\frac{a_0}{2} + a_1 \\cos x + b_1 \\sin x + a_2 \\cos 2x + b_2 \\sin 2x + \\cdots \\\\[4pt]<br \/>\n&#038;\\quad + a_n \\cos nx + b_n \\sin nx .<br \/>\n\\end{aligned}\\]<\/p>\n<\/div>\n<p><!-- ########## ########## ########## --><\/p>\n<p class=\"problem\"><span class=\"definition\">Problem 7.17<\/span><br \/>\nLet \\(v\\) and \\(w\\) be vectors in the inner product \\(V,\\) with \\(w\\) nonzero. Write down a formula for the orthogonal projection of \\(v\\) onto the subspace spanned by \\(w.\\) This is often called simply the projection of \\(v\\) onto \\(w.\\)\n<\/p>\n<div class=\"solution\">\n<p><span class=\"proof\">Solution.<\/span><br \/>\n\\[\\operatorname{proj}_w v = \\frac{\\langle w\\,\\vert\\,v\\rangle}{\\langle w\\,\\vert\\,w \\rangle} w.\\]\n<\/p>\n<\/div>\n<p><!-- ########## ########## ########## --><\/p>\n<p class=\"problem\"><span class=\"definition\">Problem 7.18<\/span><br \/>\nLet \\(W\\) be the subspace spanned by \\((1,\\,1,\\,1)\\) in \\(\\mathbb{R}^3.\\) Find a basis for \\(W^\\bot,\\) the orthogonal complement of \\(W.\\)\n<\/p>\n<div class=\"solution\" style=\"margin-bottom: 0.5em;\">\n<p><span class=\"proof\">Solution.<\/span><br \/>\nWe will find an orthogonal basis \\(v_1,\\) \\(v_2,\\) \\(v_3\\) for \\(V=\\mathbb{R}^3,\\) with \\(\\operatorname{Span}(v_1)=W.\\)<\/p>\n<p>Since \\(W=\\operatorname{Span}((1,\\,1,\\,1)),\\) let \\(v_1 = (1,\\,1,\\,1)\\) and take any \\(v_2,\\) \\(v_3\\) so that \\(v_1,\\) \\(v_2,\\) \\(v_3\\) constitutes a linearly independent family. Take<br \/>\n\\[v_1 = (1,\\,1,\\,1),\\,\\, v_2 = (1,\\,0,\\,0),\\,\\, v_3 =(0,\\,1,\\,0).\\]<br \/>\nIt is easily shown that \\(v_1,\\) \\(v_2,\\) \\(v_3\\) is linearly independent. (If this family were not linearly independent, we could choose any other \\(v_3 &#8216;\\) that is not parallel to none of \\(v_1,\\) \\(v_2\\) and \\(v_3.\\)) Hence \\(v_1,\\) \\(v_2,\\) \\(v_3\\) constitutes a basis for \\(V.\\)<\/p>\n<p>Apply Gram-Schmidt orthogonalization:<\/p>\n<p>\\[\\begin{aligned}<\/p>\n<p>u_1 &#038;= \\frac{1}{\\sqrt{3}}v_1 = \\left(\\frac{1}{\\sqrt{3}},\\,\\frac{1}{\\sqrt{3}},\\,\\frac{1}{\\sqrt{3}}\\right),\\\\[4pt]<\/p>\n<p>\\operatorname{proj}_{u_1}v_2 &#038;= \\frac{1}{\\sqrt{3}}\\left(\\frac{1}{\\sqrt{3}},\\,\\frac{1}{\\sqrt{3}},\\,\\frac{1}{\\sqrt{3}}\\right) = \\left(\\frac{1}{3},\\, \\frac{1}{3},\\, \\frac{1}{3}\\right),\\\\[4pt]<\/p>\n<p>v_2 &#8211; \\operatorname{proj}_{u_1}v_2 &#038;= \\left(\\frac{2}{3} ,\\, -\\frac{1}{3} ,\\, -\\frac{1}{3}\\right),\\\\[4pt]<\/p>\n<p>\\left\\lVert v_2 &#8211; \\operatorname{proj}_{u_1}v_2\\right\\rVert &#038;= \\frac{\\sqrt{6}}{3},\\\\[4pt]<\/p>\n<p>u_2 &#038;= \\frac{3}{\\sqrt{6}}\\left(\\frac{2}{3},\\, -\\frac{1}{3} ,\\, -\\frac{1}{3}\\right) = \\left(\\frac{2}{\\sqrt{6}} ,\\, -\\frac{1}{\\sqrt{6}} ,\\, -\\frac{1}{\\sqrt{6}}\\right),\\\\[4pt]<\/p>\n<p>\\operatorname{proj}_{u_1} v_3 &#038;= \\frac{1}{\\sqrt{3}}\\left(\\frac{1}{\\sqrt{3}},\\,\\frac{1}{\\sqrt{3}},\\,\\frac{1}{\\sqrt{3}}\\right) = \\left(\\frac{1}{3} ,\\, \\frac{1}{3} ,\\, \\frac{1}{3}\\right),\\\\[4pt]<\/p>\n<p>\\operatorname{proj}_{u_2}v_3 &#038;= -\\frac{1}{\\sqrt{6}}\\left(\\frac{2}{\\sqrt{6}} ,\\, -\\frac{1}{\\sqrt{6}} ,\\, -\\frac{1}{\\sqrt{6}}\\right) = \\left(-\\frac{1}{3} ,\\, \\frac{1}{6} ,\\, \\frac{1}{6}\\right) ,\\\\[4pt]<\/p>\n<p>v_3 &#8211; \\operatorname{proj}_{u_1}v_3 &#8211; \\operatorname{proj}_{u_2}v_3<br \/>\n&#038;= (0,\\,1,\\,0) &#8211; \\left(\\frac{1}{3},\\,\\frac{1}{3},\\,\\frac{1}{3}\\right) &#8211; \\left(-\\frac{1}{3},\\,\\frac{1}{6},\\,\\frac{1}{6}\\right) \\\\[4pt]<br \/>\n&#038;= \\left(0,\\,-\\frac{1}{2},\\,-\\frac{1}{2}\\right),\\\\[4pt]<\/p>\n<p>u_3 &#038;= \\left(0 ,\\, -\\frac{1}{\\sqrt{2}} ,\\, -\\frac{1}{\\sqrt{2}}\\right).<\/p>\n<p>\\end{aligned}\\]<\/p>\n<p>Since \\(u_1,\\) \\(u_2,\\) \\(u_3\\) is an orthonormal basis for \\(V\\) and \\(\\operatorname{Span}(v_1)=W,\\) we have \\(W^\\bot = \\operatorname{Span}(u_2 ,\\,u_3),\\) that is, \\(u_2,\\) \\(u_3\\) consitutes a basis for \\(W^\\bot.\\)\n<\/p>\n<\/div>\n<div class=\"solution\">\n<p><span class=\"proof\">Solution(Alt).<\/span><br \/>\nTake<br \/>\n\\[v_1 = (1,\\,1,\\,1),\\,\\, v_2 =(a,\\,-a,\\,0),\\,\\, v_3 = (0,\\, -b ,\\,b)\\]<br \/>\nwhere \\(a\\) and \\(b\\) are nonzero real numbers. (Choosing such vectors \\(v_2,\\) \\(v_3\\) is depend on your sense of mathematics.) It is easily shown that \\(v_1,\\) \\(v_2,\\) \\(v_3\\) is a linearly independent family and<br \/>\n\\[v_1 \\cdot v_2 =0 ,\\,\\, v_1 \\cdot v_3 =0,\\]<br \/>\nthat is,<br \/>\n\\[v_1 \\bot v_2 \\,\\,\\text{and}\\,\\, v_1 \\bot v_3 .\\]<br \/>\nHence \\(v_2,\\) \\(v_3\\) constitutes a basis for \\(W^\\bot.\\)\n<\/p>\n<\/div>\n<p><!-- ########## ########## ########## --><\/p>\n<p class=\"problem\"><span class=\"definition\">Problem 7.19<\/span><br \/>\nLet \\(W\\) be a finite-dimensional subspace of the inner product space \\(V.\\) Show that the projection map \\(\\operatorname{proj}_W : V \\rightarrow V\\) is a linear transformation. What are the kernel and image of this map?\n<\/p>\n<div class=\"solution\">\n<p><span class=\"proof\">Solution.<\/span><br \/>\nIf \\(W=V,\\) then \\(\\operatorname{proj}_W\\) is an identity function; If \\(W=\\left\\{ 0 \\right\\},\\) then \\(\\operatorname{proj}_W (v)=0\\) for any \\(v\\in V.\\) In these cases, \\(\\operatorname{proj}_W\\) is obviously a linearly transformation.<\/p>\n<p>We now consider the cases for \\(W\\ne V\\) and \\(W\\ne\\left\\{ 0 \\right\\}.\\)<\/p>\n<p>Let \\(u,\\,v\\in V\\) and \\(k\\in K,\\) where \\(K\\) is the field over which \\(V\\) is defined. Since \\(V = W \\oplus W^\\bot,\\) \\(u\\) and \\(v\\) are expressible in the unique forms:<br \/>\n\\[\\begin{aligned}<br \/>\nu &#038;= u_1 + u_2 ,\\,\\, u_1 = \\operatorname{proj}_W u \\in W ,\\,\\, u_2 = u-u_1 \\in W^\\bot ,\\\\[4pt]<br \/>\nv &#038;= v_1 + v_2 ,\\,\\, v_1 = \\operatorname{proj}_W v \\in W ,\\,\\, v_2 = v-v_1 \\in W^\\bot .<br \/>\n\\end{aligned}\\]<br \/>\nWe now see that<br \/>\n\\[u+v = (u_1 + v_1) + (u_2 + v_2);\\]<br \/>\nSince \\(u_1 +v_1 \\in W,\\) \\(u_2 + v_2 \\in W^\\bot,\\) this expression is unique, and we have<br \/>\n\\[\\operatorname{proj}_W(u+v) = u_1 +v_1.\\]<br \/>\nHence we have<br \/>\n\\[\\operatorname{proj}_W(u+v) = u_1 +v_1 = \\operatorname{proj}_W u + \\operatorname{proj}_W v.\\]<br \/>\nIn the same manner, since<br \/>\n\\[ku = ku_1 + ku_2 ,\\,\\, ku_1 \\in W ,\\,\\, ku_2 \\in W^\\bot,\\]<br \/>\nwe have<br \/>\n\\[\\operatorname{proj}_W (ku) = ku_1 = k\\operatorname{proj}_W u.\\]<br \/>\nTherefore \\(\\operatorname{proj}_W\\) is a linear transformation.\n<\/p>\n<p>Next we find the image of \\(\\operatorname{proj}_W.\\) For any \\(v\\in V,\\) \\(\\operatorname{proj}_W v\\in W,\\) and we have \\(\\operatorname{Im}(\\operatorname{proj}_W)\\subseteq W.\\) Conversely, for any \\(w\\in W,\\) take \\(v=w\\) then \\(\\operatorname{proj}_W v = w,\\) and we have \\(W\\subseteq \\operatorname{Im}(\\operatorname{proj}_W ).\\) Hence \\(\\operatorname{Im}(\\operatorname{proj}_W) = W.\\)<\/p>\n<p>In the same manner, it is easily shown that \\(\\operatorname{Ker}(\\operatorname{proj}_W) = W^\\bot.\\) (Use a basis for \\(W.\\))\n<\/p>\n<\/div>\n<p><!-- ########## ########## ########## --><\/p>\n<p class=\"problem\"><span class=\"definition\">Problem 7.20<\/span><br \/>\nIn the context of the previous problem, what is \\(\\operatorname{proj}_W \\circ \\operatorname{proj}_W?\\)\n<\/p>\n<div class=\"solution\">\n<p><span class=\"proof\">Solution.<\/span><br \/>\n\\[\\operatorname{proj}_W \\circ \\operatorname{proj}_W = \\operatorname{proj}_W.\\]\n<\/p>\n<\/div>\n<p><!-- ########## ########## ########## --><\/p>\n<p class=\"problem\"><span class=\"definition\">Problem 7.21<\/span><br \/>\nLet \\(W\\) be a nontrivial, proper subspace of the finite-dimensional inner product space \\(V\\) and again consider the projection map \\(\\operatorname{proj}_W : V \\rightarrow V.\\) Assume that the dimension of \\(W\\) is \\(m.\\) Show that there is a basis \\(B\\) for \\(V\\) such that the matrix of \\(\\operatorname{proj}_W\\) with respect to \\(B\\) takes the form<br \/>\n\\[<br \/>\n\\left(<br \/>\n\\begin{array}{c|c}<br \/>\nI_m &#038; 0 \\\\<br \/>\n\\hline<br \/>\n0 &#038; 0<br \/>\n\\end{array}<br \/>\n\\right)<br \/>\n\\]<br \/>\nwhere \\(I_m\\) is the \\(m\\times m\\) matrix, and the zeros represent zero matrices of appropriate sizes.<\/p>\n<div class=\"solution\">\n<p><span class=\"proof\">Solution.<\/span><br \/>\nLet \\(\\dim(V) = n\\) and \\(\\dim(W)=m.\\) Since \\(W\\) is finite-dimensional, we can construct an orthonormal basis for \\(W\\):<br \/>\n\\[v_1 ,\\, v_2 ,\\, \\cdots ,\\, v_m.\\]<br \/>\nSince \\(V\\) is finite-dimensional, we can extend this family to an orthonormal basis \\(B\\) for \\(V\\):<br \/>\n\\[v_1 ,\\, v_2 ,\\, \\cdots ,\\, v_m ,\\, \\cdots ,\\, v_n.\\]<br \/>\nWith this basis, we have<br \/>\n\\[M_{B,B}(\\operatorname{proj}_W) = \\left(<br \/>\n\\begin{array}{c|c}<br \/>\nI_m &#038; 0 \\\\<br \/>\n\\hline<br \/>\n0 &#038; 0<br \/>\n\\end{array}<br \/>\n\\right).\\]\n<\/p>\n<\/div>\n<p><!-- ########## ########## ########## --><\/p>\n<p class=\"problem\"><span class=\"definition\">Problem 7.22<\/span><br \/>\nShow that complex conjugation is a bijection map from \\(\\mathbb{C}\\) into itself.\n<\/p>\n<div class=\"solution\">\n<p><span class=\"proof\">Solution.<\/span><br \/>\nLet \\(\\phi : \\mathbb{C} \\rightarrow \\mathbb{C}\\) be given by<br \/>\n\\[\\phi(z) = \\bar{z}\\]<br \/>\nfor \\(z\\in \\mathbb{C}.\\) For any \\(z\\in \\mathbb{C},\\) we have<br \/>\n\\[\\phi(\\bar{z}) = \\bar{\\bar{z}} = z;\\]<br \/>\nHence \\(\\phi\\) is onto.\n<\/p>\n<\/div>\n<p><!-- ########## ########## ########## --><\/p>\n<p class=\"problem\"><span class=\"definition\">Problem 7.23<\/span><br \/>\nShow that \\(\\mathbb{C}^n\\) is isomorphic to \\(\\mathbb{R}^{2n}\\) as real vector spaces.\n<\/p>\n<div class=\"solution\">\n<p><span class=\"proof\">Solution.<\/span><br \/>\nDefine \\(\\phi : \\mathbb{C}^{n} \\rightarrow \\mathbb{R}^{2n}\\) by<br \/>\n\\[\\phi(z_1 ,\\, z_2 ,\\, \\cdots ,\\,z_n ) = (\\operatorname{Re}(z_1),\\, \\operatorname{Im}(z_1) ,\\, \\operatorname{Re}(z_2),\\,\\operatorname{Im}(z_2),\\,\\cdots,\\,\\operatorname{Re}(z_n),\\,\\operatorname{Im}(z_n)).\\]<br \/>\nKeep calm and show that \\(\\phi\\) is an isomorphism.\n<\/p>\n<\/div>\n<p><!-- ########## ########## ########## --><\/p>\n<p class=\"problem\"><span class=\"definition\">Problem 7.24<\/span><br \/>\nFind the length of the following vector in \\(\\mathbb{C}^2 :\\)<br \/>\n\\[(2+5i ,\\, 1-4i ).\\]<br \/>\nRemember that the canonical inner product on \\(\\mathbb{C}^2\\) requires conjugation.\n<\/p>\n<div class=\"solution\">\n<p><span class=\"proof\">Solution.<\/span><br \/>\n\\[\\begin{aligned}<br \/>\n\\langle (2+5i ,\\, 1-4i) \\,\\vert\\, (2+5i ,\\,1-4i)\\rangle<br \/>\n&#038;= (2+5i)\\overline{(2+5i)} + (1-4i)\\overline{(1-4i)} \\\\[4pt]<br \/>\n&#038;= (2+5i)(2-5i) + (1-4i)(1+4i) \\\\[4pt]<br \/>\n&#038;= 4 + 25 + 1 + 16 = 46 , \\\\[4pt]<br \/>\n\\lVert (2+5i ,\\, 1-4i ) \\rVert &#038;= \\sqrt{46}.<br \/>\n\\end{aligned}<br \/>\n\\]<\/p>\n<\/div>\n<p><!-- ########## ########## ########## --><\/p>\n<p class=\"problem\"><span class=\"definition\">Problem 7.25<\/span><br \/>\nLet \\(V\\) be the complex vector space of continuous complex-valued functions on the interval \\([-\\pi ,\\, \\pi ].\\) Consider the function \\(f\\in V\\) defined by \\(f(x)=e^{ix}.\\) Find the length of \\(f\\) in \\(V.\\)\n<\/p>\n<div class=\"solution\">\n<p><span class=\"proof\">Solution.<\/span><br \/>\nRecall that<br \/>\n\\[f(x) = e^{ix} = \\cos x + i\\sin x\\]<br \/>\nfor \\(x\\in\\mathbb{R}.\\) Hence we have<br \/>\n\\[\\begin{aligned}<br \/>\n\\int_{-\\pi}^{\\pi} \\langle f\\,\\vert\\,f \\rangle dx<br \/>\n&#038;= \\int_{-\\pi}^{\\pi} (\\cos x + i \\sin x)(\\cos x &#8211; i\\sin x) dx \\\\[4pt]<br \/>\n&#038;= \\int_{-\\pi}^{\\pi} (\\cos^2 x + \\sin^2 x) dx \\\\[4pt]<br \/>\n&#038;= \\int_{-\\pi}^{\\pi} 1\\,dx = 2\\pi ,\\\\[4pt]<br \/>\n\\lVert f \\rVert &#038;= \\sqrt{2\\pi}.<br \/>\n\\end{aligned}\\]<\/p>\n<\/div>\n<p><!-- ########## ########## ########## --><\/p>\n<p class=\"problem\"><span class=\"definition\">Problem 7.26<\/span><br \/>\nIn \\(\\mathbb{C}^n\\) we defined the canonical inner product by<br \/>\n\\[\\langle \\mathbf{x} \\vert \\mathbf{y} \\rangle = \\sum _ {j=1} ^n x_j \\, \\overline{y_j}.\\]<br \/>\nWhy not define it instead more simply as<br \/>\n\\[\\langle \\mathbf{x} \\vert \\mathbf{y} \\rangle = \\sum _ {j=1} ^n x_j \\,y_j\\]<br \/>\nwithout conjugation of the \\(y_j ?\\) What essential feature would be lost?\n<\/p>\n<div class=\"solution\">\n<p><span class=\"proof\">Solution.<\/span><br \/>\nIf the inner product were defined without conjugation, a length of a vector might be complex. In this case, we cannot compare the distances of vectors.\n<\/p>\n<\/div>\n<p><!-- ########## ########## ########## --><\/p>\n<p class=\"problem\"><span class=\"definition\">Problem 7.27<\/span><br \/>\nShow that in a complex inner product space we have<br \/>\n\\[\\lVert av \\rVert = \\lvert a \\rvert \\cdot \\lVert v \\rVert\\]<br \/>\nfor all \\(v\\in V,\\) \\(a\\in \\mathbb{C}.\\) (This generalizes another familiar property of real inner products and is needed to extend the proof of Proposition 7.6 to the complex case.)\n<\/p>\n<div class=\"solution\">\n<p><span class=\"proof\">Solution.<\/span><br \/>\n\\[\\begin{aligned}<br \/>\n\\lVert av \\rVert<br \/>\n&#038;= \\sqrt{\\langle av \\,\\vert\\, av \\rangle} \\\\[4pt]<br \/>\n&#038;= \\sqrt{a\\langle v\\,\\vert\\, av \\rangle} \\\\[4pt]<br \/>\n&#038;= \\sqrt{a\\overline{a} \\langle v\\,\\vert\\, v \\rangle} \\\\[4pt]<br \/>\n&#038;= \\sqrt{\\lvert a \\rvert^2 \\langle v\\,\\vert\\, v \\rangle} \\\\[4pt]<br \/>\n&#038;= \\lvert a \\rvert \\sqrt{ \\langle v\\,\\vert\\, v \\rangle} \\\\[4pt]<br \/>\n&#038;= \\lvert a \\rvert \\cdot \\lVert v \\rVert.<br \/>\n\\end{aligned}\\]<\/p>\n<\/div>\n<p><!-- ########## ########## ########## --><\/p>\n<p class=\"problem\"><span class=\"definition\">Problem 7.28<\/span><br \/>\nLet \\(V\\) be a complex vector space with basis \\(\\left\\{ v_j \\,\\vert\\, j\\in J \\right\\}\\) where \\(J\\) is some index set, possibly infinite. Then show that \\(V\\) as a real vector space has the basis \\(\\left\\{ v_j ,\\, iv_j \\,\\,\\vert\\,\\, j\\in J \\right\\}.\\) Hence if \\(V\\) has dimension \\(n\\) over \\(\\mathbb{C},\\) it has dimension \\(2n\\) over \\(\\mathbb{R}.\\)\n<\/p>\n<div class=\"solution\">\n<p><span class=\"proof\">Solution.<\/span><br \/>\nFor any \\(v\\in V,\\) \\(v\\) is expressed in the unique form<br \/>\n\\[v = \\lambda_1 v_1 + \\lambda_2 v_2 + \\cdots\\]<br \/>\nwhere \\(\\lambda_j\\)s are complex numbers, and all but finite \\(\\lambda_j\\)s are zero. Each \\(\\lambda_j\\) is expressed in the unique form<br \/>\n\\[\\lambda_j = a_j + ib_j\\]<br \/>\nwhere \\(a_j\\) and \\(b_j\\) are real numbers. Hence<br \/>\n\\[\\begin{aligned}<br \/>\nv &#038;= (a_1 + ib_1)v_1 + (a_2 + ib_2)v_2 + \\cdots \\\\[4pt]<br \/>\n&#038;= a_1 v_1 + b_1 iv_1 + a_2 v_2 + b_2 iv_2 + \\cdots .<br \/>\n\\end{aligned}\\]<br \/>\nThis expression is unique; Hence \\(\\left\\{v_j ,\\, iv_j \\,\\vert\\,j\\in J\\right\\}\\) constitutes a basis for \\(V\\) over \\(\\mathbb{R}.\\)\n<\/p>\n<\/div>\n<p><!-- ########## ########## ########## --><\/p>\n<p class=\"problem\"><span class=\"definition\">Problem 7.29<\/span><br \/>\nLet \\(V\\) be a complex inner product space and let \\(v\\) be any nonzero vector in \\(V.\\) Show that \\(\\langle v \\,\\vert\\, iv \\rangle \\ne 0\\) but nevertheless the angle between \\(v\\) and \\(iv\\) is \\(\\pi \/2.\\) Hence in a complex inner product space, vectors forming a right angle need not be formally orthogonal. How, then, can one reconcile these notions? See the following problem.\n<\/p>\n<div class=\"solution\">\n<p><span class=\"proof\">Solution.<\/span><br \/>\nLet \\(\\theta\\) be the angle between \\(v\\) and \\(iv.\\)<br \/>\n\\[\\begin{gather}<br \/>\n\\langle v\\,\\vert\\, iv \\rangle = -i \\langle v\\,\\vert\\, v \\rangle = -i \\lVert v \\rVert^2 \\ne 0,\\\\[4pt]<br \/>\n\\cos\\theta = \\frac{\\operatorname{Re}(\\langle v\\,\\vert\\, iv\\rangle)}{\\lVert v \\rVert \\lVert iv \\rVert}<br \/>\n= \\frac{0}{\\lVert v \\rVert \\lVert iv \\rVert} =0.<br \/>\n\\end{gather}\\]\n<\/p>\n<\/div>\n<p><!-- ########## ########## ########## --><\/p>\n<p class=\"problem\"><span class=\"definition\">Problem 7.30<\/span><br \/>\nShow that for two complex numbers \\(z\\) and \\(w,\\) the product \\(z \\overline{w}\\) is purely imaginary if and only if \\(z\\) and \\(w\\) are orthogonal as points of \\(\\mathbb{R}^2.\\) This at least reconciles perpendicularity and orthogonality in \\(\\mathbb{C}.\\) Now generalize this to higher dimensions.\n<\/p>\n<div class=\"solution\">\n<p><span class=\"proof\">Solution.<\/span><br \/>\nLet \\(z=a+bi,\\) \\(w=c+di\\) where \\(a,\\) \\(b,\\) \\(c,\\) \\(d\\) are real numbers. First, observe that<br \/>\n\\[z\\overline{w} = (a+bi)(c-di) = (ac+bd) + (bc-ad)i,\\]<br \/>\nhence \\(z\\overline{w}\\) is purely imaginary if and only if \\(ac+bd=0.\\)<\/p>\n<p>Next, in \\(\\mathbb{R}^2,\\) since \\([z]=(a,\\,b)\\) and \\([w]=(c,\\,d),\\) we have<br \/>\n\\[\\langle z\\,\\vert\\,w\\rangle = \\langle (a,\\,b) \\,\\vert\\,(c,\\,d)\\rangle = ac+bd.\\]<br \/>\nHence \\(z\\bot w\\) if and only if \\(ac+bd=0.\\)<\/p>\n<p>Therefore \\(z\\bot w\\) in \\(\\mathbb{R}^2\\) if and only if \\(z\\overline{w}\\) is purely imaginary.<\/p>\n<p>We now generalize this to higher dimensions. We only consider for the finite dimensional spaces. Let \\(z,\\,w\\in \\mathbb{C}^n,\\) then \\(z\\) and \\(w\\) are expressible by<br \/>\n\\[\\begin{aligned}<br \/>\nz &#038;= (z_1 ,\\, z_2 ,\\, \\cdots ,\\, z_n ),\\\\[4pt]<br \/>\nw &#038;= (w_1 ,\\, w_2 ,\\, \\cdots ,\\, w_n ),\\\\[4pt]<br \/>\nz_j &#038;= a_j + ib_j ,\\\\[4pt]<br \/>\nw_j &#038;= c_j + id_j<br \/>\n\\end{aligned}\\]<br \/>\nwhere \\(a_j,\\) \\(b_j,\\) \\(c_j,\\) \\(d_j\\) are real numbers.<\/p>\n<p>First, observe that<br \/>\n\\[\\begin{aligned}<br \/>\n\\langle z\\,\\vert\\, w\\rangle<br \/>\n&#038;= z_1 \\overline{w_1} + \\cdots + z_n \\overline{w_n} \\\\[4pt]<br \/>\n&#038;= (a_1 + ib_1)(c_1 &#8211; id_1) + \\cdots + (a_n +ib_n)(c_n-id_n) \\\\[4pt]<br \/>\n&#038;= [ (a_1 c_1 + b_1 d_1) + \\cdots + (a_n c_n + b_n d_n )] + [ (b_1 c_1 &#8211; a_1 d_1 ) + \\cdots + (b_n c_n -a_n d_n)]i.<br \/>\n\\end{aligned}\\]<br \/>\nHence \\(\\langle z\\,\\vert\\,w\\rangle\\) is purely imaginary if and only if<br \/>\n\\[(a_1 c_1 + b_1 d_1) + \\cdots + (a_n c_n + b_n d_n )=0.\\]<br \/>\nNext, in \\(\\mathbb{R}^{2n},\\) let<br \/>\n\\[\\begin{aligned}<br \/>\n\\mathbf{x} &#038;= (a_1 ,\\, b_1 ,\\, a_2 ,\\, b_2 ,\\, \\cdots ,\\, a_n ,\\, b_n ),\\\\[4pt]<br \/>\n\\mathbf{y} &#038;= (c_1 ,\\, d_1 ,\\, c_2 ,\\, d_2 ,\\, \\cdots ,\\, c_n ,\\, d_n ).<br \/>\n\\end{aligned}\\]<br \/>\nThen<br \/>\n\\[\\mathbf{x}\\cdot\\mathbf{y} = (a_1 c_1 + b_ 1 d_1) + \\cdots + (a_n c_n + b_n d_n ).\\]<br \/>\nHence \\(\\mathbf{x} \\bot \\mathbf{y}\\) if and only if<br \/>\n\\[(a_1 c_1 + b_1 d_1) + \\cdots + (a_n c_n + b_n d_n )=0.\\]<br \/>\nBut for \\([z] = \\mathbf{x} ,\\) \\([w] = \\mathbf{y}\\) in \\(\\mathbb{R}^{2n},\\) we conclude that \\(\\langle z\\,\\vert\\,w\\rangle\\) is purely imaginary if and only if \\(z\\bot w\\) in \\(\\mathbb{R}^{2n},\\) that is, \\(z\\bot w\\) in \\(\\mathbb{C}^n\\) if and only if \\(z\\bot w\\) in \\(\\mathbb{R}^{2n}.\\)<\/p>\n<\/div>\n<p><!--\n<!-- ########## ########## ########## --\n\n\n<p class=\"problem\"><span class=\"definition\">Problem 7.<\/span><br \/>\nQ\n<\/p>\n\n\n\n\n\n<div class=\"solution\">\n\n\n<p><span class=\"proof\">Solution.<\/span>\n(To be filled.)\n<\/p>\n\n\n<\/div>\n\n\n--><\/p>\n<p><!--\n\\[\n\\left(\n\\begin{array}{cccr|c}\n1 & 0 & 3 & -1 & 0 \\\\\n\\hline\n0 & 1 & 1 & -1 & 0 \\\\\n0 & 0 & 0 & 0 & 0 \\\\\n\\end{array}\n\\right)\n\\]\n--><\/p>\n<p><!-- --><\/p>\n","protected":false},"excerpt":{"rendered":"<p>This set of exercises is retrieved from the seventh chapter of Linear Algebra by Robert J. Valenza. Note that these solutions are not fully elaborated; You have to fill the descriptions by yourself. Problem 7.1 In \\(\\mathbb{R}^3,\\) compute the inner product of \\((1,\\,2,\\,-1)\\) and \\((2,\\,1,\\,4).\\) What is the length of each vector? What is the angle between these vectors? Solution. The lengths of given&hellip;<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_lmt_disableupdate":"","_lmt_disable":"","footnotes":""},"categories":[57],"tags":[402,416,415,400,412,411],"class_list":["post-5225","post","type-post","status-publish","format-standard","hentry","category-linear-algebra","tag-exercises","tag-inner-product","tag-inner-product-space","tag-linear-algebra","tag-linear-transformation","tag-vector-space"],"_links":{"self":[{"href":"https:\/\/sasamath.com\/blog\/wp-json\/wp\/v2\/posts\/5225","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/sasamath.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/sasamath.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/sasamath.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/sasamath.com\/blog\/wp-json\/wp\/v2\/comments?post=5225"}],"version-history":[{"count":106,"href":"https:\/\/sasamath.com\/blog\/wp-json\/wp\/v2\/posts\/5225\/revisions"}],"predecessor-version":[{"id":6535,"href":"https:\/\/sasamath.com\/blog\/wp-json\/wp\/v2\/posts\/5225\/revisions\/6535"}],"wp:attachment":[{"href":"https:\/\/sasamath.com\/blog\/wp-json\/wp\/v2\/media?parent=5225"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/sasamath.com\/blog\/wp-json\/wp\/v2\/categories?post=5225"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/sasamath.com\/blog\/wp-json\/wp\/v2\/tags?post=5225"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}