{"id":613,"date":"2020-09-09T01:27:23","date_gmt":"2020-09-09T08:27:23","guid":{"rendered":"http:\/\/gantovnik.com\/bio-tips\/?p=613"},"modified":"2020-09-09T02:29:21","modified_gmt":"2020-09-09T09:29:21","slug":"93-summing-values-of-a-column-using-awk-command","status":"publish","type":"post","link":"https:\/\/gantovnik.com\/bio-tips\/2020\/09\/93-summing-values-of-a-column-using-awk-command\/","title":{"rendered":"#93 Summing values of a column using awk"},"content":{"rendered":"<p>#93 Summing values of a column using awk command<\/p>\n<p>Assume we have &#8220;test1.txt&#8221; file with data in columns:<\/p>\n<pre class=\"brush: python; title: ; notranslate\" title=\"\">\r\na,a,aa,1\r\na,a,aa,2\r\nd,d,dd,7\r\nd,d,dd,9\r\nd,dd,d,0\r\nd,d,dd,23\r\nd,d,dd,152\r\nd,d,dd,7\r\nd,d,dd,5\r\nf2,f2,f2,5.5\r\n<\/pre>\n<p>Save the following awk script in the file &#8220;ex93.txt&#8221;<\/p>\n<pre class=\"brush: python; title: ; notranslate\" title=\"\">\r\n#The -F',' tells awk that the field separator for the input is a comma.\r\n#The {sum+=$4;} adds the value of the 4th column to a running total.\r\n#The END{print sum;} tells awk to print the contents of sum after all lines are read.\r\nawk -F ',' '{sum+=$4;} END{print sum;}' test1.txt\r\n<\/pre>\n<p>Run this script<\/p>\n<pre class=\"brush: python; title: ; notranslate\" title=\"\">\r\n.\/ex93.txt\r\n<\/pre>\n<p>The result is<\/p>\n<pre class=\"brush: python; title: ; notranslate\" title=\"\">\r\n211.5\r\n<\/pre>\n","protected":false},"excerpt":{"rendered":"<p>#93 Summing values of a column using awk command Assume we have &#8220;test1.txt&#8221; file with data in columns: a,a,aa,1 a,a,aa,2 d,d,dd,7 d,d,dd,9 d,dd,d,0 d,d,dd,23 d,d,dd,152 d,d,dd,7 d,d,dd,5 f2,f2,f2,5.5 Save the following awk script in the file &#8220;ex93.txt&#8221; #The -F&#8217;,&#8217; tells awk that the field separator for the input is a comma. #The {sum+=$4;} adds the [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"nf_dc_page":"","_et_pb_use_builder":"","_et_pb_old_content":"","_et_gb_content_width":"","_lmt_disableupdate":"yes","_lmt_disable":"","jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[18],"tags":[],"class_list":["post-613","post","type-post","status-publish","format-standard","hentry","category-awk"],"modified_by":"gantovnik","jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/p8bH0k-9T","jetpack_likes_enabled":true,"jetpack-related-posts":[{"id":616,"url":"https:\/\/gantovnik.com\/bio-tips\/2020\/09\/94-average-of-values-of-a-column-using-awk\/","url_meta":{"origin":613,"position":0},"title":"#94 Average of  values of a column using awk","author":"gantovnik","date":"2020-09-09","format":false,"excerpt":"#94 Average of values of a column using awk command Assume we have \"test1.txt\" file with data in columns: [code language=\"python\"] a,a,aa,1 a,a,aa,2 d,d,dd,7 d,d,dd,9 d,dd,d,0 d,d,dd,23 d,d,dd,152 d,d,dd,7 d,d,dd,5 f2,f2,f2,5.5 [\/code] Save the following awk script in the file \"ex94.awk\" [code language=\"python\"] #!\/bin\/awk -f { sum += $4 }\u2026","rel":"","context":"In &quot;awk&quot;","block_context":{"text":"awk","link":"https:\/\/gantovnik.com\/bio-tips\/category\/awk\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":833,"url":"https:\/\/gantovnik.com\/bio-tips\/2021\/01\/147-count-the-total-number-of-fields-in-a-file-using-awk\/","url_meta":{"origin":613,"position":1},"title":"#147 Count the total number of fields in a file using awk","author":"gantovnik","date":"2021-01-14","format":false,"excerpt":"#147 Count the total number of fields in a file using awk Assume we have \"test1.txt\" file with data in columns: [code language=\"python\"] a b c d e f g h i j k l 1 2 3 4 [\/code] Save the following awk script in the file \"ex147.awk\" [code\u2026","rel":"","context":"In &quot;awk&quot;","block_context":{"text":"awk","link":"https:\/\/gantovnik.com\/bio-tips\/category\/awk\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":1903,"url":"https:\/\/gantovnik.com\/bio-tips\/2023\/07\/368-performing-calculations-column-wise-using-awk\/","url_meta":{"origin":613,"position":2},"title":"#368 Performing calculations column-wise using awk","author":"gantovnik","date":"2023-07-20","format":false,"excerpt":"example.csv [code language=\"python\"] Type,LCID,EID,Nx,Ny,Nxy,Mx,My,Mxy,Qyz,Qxz QUAD,5000001,389635,5.21044,0.9993295,3.184029,0.228490059,0.762438914,0.349926963,0.007402616,0.645762323 QUAD,5000002,389636,4.332321,-45.55149,10.13951,0.128933201,0.289045003,0.442976734,0.394346902,0.965424659 QUAD,5000003,389637,5.332321,-65.55149,12.32391,0.867613103,0.345799842,0.902593358,0.56308979,0.77084519 QUAD,5000004,389638,4.332321,-35.55149,14.27251,0.429855813,0.882431001,0.15453015,0.710809946,0.918974895 QUAD,5000005,389639,5.332455,-75.55149,15.37321,0.738401857,0.289007109,0.59902178,0.824840285,0.571976301 QUAD,5000006,389640,4.332321,-65.55149,13.27221,0.102678011,0.581496802,0.785601755,0.415283869,0.817283531 QUAD,5000007,389641,3.332321,-45.55149,12.67351,0.363658748,0.803570041,0.70688413,0.459446702,0.330453157 [\/code] ex368.txt [code language=\"python\"] awk 'NR==1{''} NR>1{{ SUM=SUM+$4 }} END { print \"Sum=\" SUM }' FS=, OFS=, example.csv [\/code] output: [code language=\"python\"] Sum=32.2045 [\/code] ex368.txt [code language=\"python\"] awk 'NR==1{''} NR>1{{ SUM=SUM+$4 }} END {print \"Mean=\" SUM\/(NR-1)}' FS=, OFS=, example.csv\u2026","rel":"","context":"In &quot;awk&quot;","block_context":{"text":"awk","link":"https:\/\/gantovnik.com\/bio-tips\/category\/awk\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":842,"url":"https:\/\/gantovnik.com\/bio-tips\/2021\/01\/148-print-lines-containing-words-bar-gap-quad-and-count-number-of-lines-in-each-group-using-awk\/","url_meta":{"origin":613,"position":3},"title":"#148 Print lines containing words &#8220;BAR&#8221;, &#8220;GAP&#8221;, &#8220;QUAD&#8221; and count number of lines in each group using awk","author":"gantovnik","date":"2021-01-15","format":false,"excerpt":"#148 Print lines containing words \"BAR\", \"GAP\", \"QUAD\" and count number of lines in each group using awk Save the following awk script in the file \"ex148.awk\" [code language=\"python\"] #!\/bin\/awk -f \/GAP\/{print;n_gap++} \/BAR\/{print;n_bar++} \/QUAD\/{print;n_quad++} END { printf \"n_gap=%i\\n\",n_gap; printf \"n_bar=%i\\n\",n_bar;printf \"n_quad=%i\\n\",n_quad } [\/code] Run file \"ex148run.txt\" [code language=\"python\"] awk -f\u2026","rel":"","context":"In &quot;awk&quot;","block_context":{"text":"awk","link":"https:\/\/gantovnik.com\/bio-tips\/category\/awk\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":1905,"url":"https:\/\/gantovnik.com\/bio-tips\/2023\/07\/370-find-max-and-min-in-column-using-awk\/","url_meta":{"origin":613,"position":4},"title":"#370 Find min and max in column using awk","author":"gantovnik","date":"2023-07-21","format":false,"excerpt":"example.csv [code language=\"python\"] Type,LCID,EID,Nx,Ny,Nxy,Mx,My,Mxy,Qyz,Qxz QUAD,5000001,389635,5.21044,0.9993295,3.184029,0.228490059,0.762438914,0.349926963,0.007402616,0.645762323 QUAD,5000002,389636,4.332321,-45.55149,10.13951,0.128933201,0.289045003,0.442976734,0.394346902,0.965424659 QUAD,5000003,389637,5.332321,-65.55149,12.32391,0.867613103,0.345799842,0.902593358,0.56308979,0.77084519 QUAD,5000004,389638,4.332321,-35.55149,14.27251,0.429855813,0.882431001,0.15453015,0.710809946,0.918974895 QUAD,5000005,389639,5.332455,-75.55149,15.37321,0.738401857,0.289007109,0.59902178,0.824840285,0.571976301 QUAD,5000006,389640,4.332321,-65.55149,13.27221,0.102678011,0.581496802,0.785601755,0.415283869,0.817283531 QUAD,5000007,389641,3.332321,-45.55149,12.67351,0.363658748,0.803570041,0.70688413,0.459446702,0.330453157 [\/code] ex370.txt [code language=\"python\"] awk 'NR==2 || $4 < min {min=$4} END{ print \"min=\" min}' FS=, OFS=, example.csv awk 'NR==2 || $4 > max {max=$4} END{ print \"max=\" max}' FS=, OFS=, example.csv [\/code] output: [code language=\"python\"] min=3.332321 max=50.332455 [\/code]\u2026","rel":"","context":"In &quot;awk&quot;","block_context":{"text":"awk","link":"https:\/\/gantovnik.com\/bio-tips\/category\/awk\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":1883,"url":"https:\/\/gantovnik.com\/bio-tips\/2023\/07\/357-joining-groups-of-lines-in-a-text-file-using-awk\/","url_meta":{"origin":613,"position":5},"title":"#357 Joining groups of lines in a text file using awk","author":"gantovnik","date":"2023-07-14","format":false,"excerpt":"Joining groups of lines in a text file. The prints three consecutive lines of text on the same line, after which a linefeed is printed. This has the effect of \"joining\" every three consecutive lines of text. example.txt [code language=\"python\"] 1 2 3 4 5 6 7 8 9 [\/code]\u2026","rel":"","context":"In &quot;awk&quot;","block_context":{"text":"awk","link":"https:\/\/gantovnik.com\/bio-tips\/category\/awk\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]}],"_links":{"self":[{"href":"https:\/\/gantovnik.com\/bio-tips\/wp-json\/wp\/v2\/posts\/613","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/gantovnik.com\/bio-tips\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/gantovnik.com\/bio-tips\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/gantovnik.com\/bio-tips\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/gantovnik.com\/bio-tips\/wp-json\/wp\/v2\/comments?post=613"}],"version-history":[{"count":0,"href":"https:\/\/gantovnik.com\/bio-tips\/wp-json\/wp\/v2\/posts\/613\/revisions"}],"wp:attachment":[{"href":"https:\/\/gantovnik.com\/bio-tips\/wp-json\/wp\/v2\/media?parent=613"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/gantovnik.com\/bio-tips\/wp-json\/wp\/v2\/categories?post=613"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/gantovnik.com\/bio-tips\/wp-json\/wp\/v2\/tags?post=613"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}