計算サーバ ノードハングアップ

計算サーバ利用者の皆様

国立天文台 天文シミュレーションプロジェクトです。

計算サーバのノードで大量のハングアップが発生しました。
この障害は現在は回復しておりますが、先に投入されていた末尾のジョブが強制終了されてしまいました。
これらのジョブは投入時の設定によっては自動的に再投入されます(Job ID は不変です)。
しかし、自動的な再投入の有無に関わらず出力ファイルを確認するなどし、
必要な場合にはあらためて再投入などを行って頂くよう、よろしくお願い申し上げます。

各ジョブに関する情報は以下の tracejob コマンドで取得できます。
例: $ tracejob ジョブID

本件では多大な御迷惑をお掛けしたことを深くお詫び申し上げます。
本メールに関するご質問やご意見は以下のページからお寄せ下さい。
http://www.cfca.nao.ac.jp/inquiry
--
国立天文台 天文シミュレーションプロジェクト

418246[1].m000. brassrrm long EJS-5RH 20345 1 R 516:3 mis41/0
418246[2].m000. brassrrm long EJS-5RH 10054 1 R 516:3 mis63/1
418246[3].m000. brassrrm long EJS-5RH 10077 1 R 516:3 mis63/3
418246[4].m000. brassrrm long EJS-5RH 20393 1 R 516:3 mis41/1
418246[6].m000. brassrrm long EJS-5RH 25911 1 R 516:3 mis26/1
418246[11].m000 brassrrm long EJS-5RH 26942 1 R 516:3 mis60/3
418246[25].m000 brassrrm long EJS-5RH 22717 1 R 516:3 mis42/0
418246[29].m000 brassrrm long EJS-5RH 25524 1 R 516:3 mis31/1
418246[31].m000 brassrrm long EJS-5RH 28641 1 R 516:3 mis23/3

418769.m000.cfc furuswsn long lmc35e02t0 12376 1 R 350:4 mis40/1
419361.m000.cfc furuswsn long lmc36e02t0 15358 1 R 76:33 mis25/3

406143.m000.cfc itootk long D11GPscurr 14585 1 R 1421: mis46/1
406152.m000.cfc itootk long D11GPscurr 27196 1 R 06:45 mis07/1
406155.m000.cfc itootk long D11GPscurr 14109 1 R 1421: mis60/0
406157.m000.cfc itootk long D11GPscurr 12953 1 R 1421: mis54/0
406166.m000.cfc itootk long D11GPscurr 12994 1 R 1421: mis62/1
406167.m000.cfc itootk long D11GPscurr 13666 1 R 1421: mis59/0
406158.m000.cfc itootk long D11GPscurr 26583 1 R 06:35 mis58/0
406463.m000.cfc itootk long re-1-GP-r4 16402 1 R 1287: mis26/3
406439.m000.cfc itootk long re-1GPs_r1 15600 1 R 1298: mis59/1

404524.m000.cfc lykawkpt long tpf 15001 1 R 1351: mis05/2
404528.m000.cfc lykawkpt long tpf 19081 1 R 1719: mis06/1
418068.m000.cfc lykawkpt long tpf 27209 1 R 06:45 mis07/2
418221.m000.cfc lykawkpt long tpf 7682 1 R 555:3 mis60/1
418222.m000.cfc lykawkpt long tpf 18825 1 R 555:1 mis05/1
418994.m000.cfc lykawkpt long tpf 28600 1 R 06:39 mis28/2
419223.m000.cfc lykawkpt long tpf 29182 1 R 125:4 mis55/0
419224.m000.cfc lykawkpt long tpf 6457 1 R 102:5 mis23/0

419227.m000.cfc nagaotk long job2_tau1 4398 1 R 109:4 mis14/0
419232.m000.cfc nagaotk long job25_tau1 4446 1 R 109:4 mis14/2
419239.m000.cfc nagaotk long job3_tau3 28948 1 R 109:3 mis31/0
419240.m000.cfc nagaotk long job3_tau10 28960 1 R 109:3 mis32/0
419245.m000.cfc nagaotk long job35_tau1 3945 1 R 109:2 mis59/3
419247.m000.cfc nagaotk long job4_tau1 16198 1 R 107:5 mis63/2
419248.m000.cfc nagaotk long job4_tau2 21115 1 R 105:1 mis42/3
419249.m000.cfc nagaotk long job4_tau3 29582 1 R 99:32 mis06/2
419332.m000.cfc nagaotk long jet2_tau1 14938 1 R 34:23 mis25/3
419333.m000.cfc nagaotk long jet2_tau2 6860 1 R 41:20 mis61/0
419335.m000.cfc nagaotk long jet2_tau10 20755 1 R 72:42 mis24/3
419337.m000.cfc nagaotk long jet25_tau1 25450 1 R 52:05 mis46/3
419339.m000.cfc nagaotk long jet25_tau3 21772 1 R 40:11 mis11/0
419343.m000.cfc nagaotk long jet3_tau2 30782 1 R 61:46 mis41/3
419355.m000.cfc nagaotk long jet4_tau10 10791 1 R 48:12 mis32/1
422890.m000.cfc nagaotk long job4_tau10 2893 1 R 00:27 mis61/3

391544.m000.cfc nomurahd long chem_1_2au 12383 1 R 06:27 mis48/2
391809.m000.cfc nomurahd long chem_crich 15320 1 R 2362: mis06/0

401187.m000.cfc ogihrams long Feb16_run2 15823 1 R 2358: mis11/3
401190.m000.cfc ogihrams long Feb16_run2 15826 1 R 2346: mis14/3
401186.m000.cfc ogihrams long Feb16_run2 15827 1 R 2236: mis10/3
401214.m000.cfc ogihrams long Feb16_run3 15853 1 R 2087: mis40/3
401226.m000.cfc ogihrams long Feb16_run3 15876 1 R 1714: mis54/2
401227.m000.cfc ogihrams long Feb16_run3 15896 1 R 2069: mis61/3
401268.m000.cfc ogihrams long Feb16_run1 5047 1 R 1689: mis57/2
405848.m000.cfc ogihrams long Feb16_run2 10756 1 R 1432: mis15/3
406052.m000.cfc ogihrams long Feb16_run3 12097 1 R 1432: mis42/2
406472.m000.cfc ogihrams long Feb16_run4 25085 1 R 1154: mis15/1
419356.m000.cfc ogihrams long Feb16_run4 32739 1 R 18:06 mis62/2
419357.m000.cfc ogihrams long Feb16_run4 10723 1 R 14:22 mis55/3
419358.m000.cfc ogihrams long Feb16_run4 7402 1 R 42:16 mis31/3
413836.m000.cfc ogihrams long Feb16_run4 2419 1 R 817:3 mis23/0
422901.m000.cfc ogihrams long Feb16_run3 2896 1 R 00:13 mis32/3
422902.m000.cfc ogihrams long Feb16_run3 2890 1 R 00:13 mis31/3
422903.m000.cfc ogihrams long Feb16_run2 2886 1 R 00:14 mis26/3
422904.m000.cfc ogihrams long Feb16_run2 2891 1 R 00:28 mis25/3
422905.m000.cfc ogihrams long Feb16_run2 2892 1 R 00:26 mis24/3

418952.m000.cfc shibatat long shock12 7070 1 R 285:2 mis10/1

406207.m000.cfc shibgkst long 090.12.0B 13022 1 R 1417: mis11/2

418556.m000.cfc takiwkkz long STLs40 7458 1 R 401:1 mis54/1
418784.m000.cfc takiwkkz long STLs40old 29869 1 R 343:2 mis10/0

413181.m000.cfc tomingnz long lc0570 4125 1 R 978:5 mis09/0
413280.m000.cfc tomingnz long lc0768 16153 1 R 919:0 mis32/2
413294.m000.cfc tomingnz long lc0796 5351 1 R 857:2 mis62/2
413549.m000.cfc tomingnz long lc1306 16673 1 R 706:3 mis40/2
421929.m000.cfc tomingnz long 20170313-3 18264 1 R 00:17 mis10/2
421931.m000.cfc tomingnz long 20170313-3 13808 1 R 00:17 mis40/0
421936.m000.cfc tomingnz long 20170313-3 4151 1 R 00:13 mis61/2
421937.m000.cfc tomingnz long 20170313-3 2795 1 R 00:13 mis32/2
421938.m000.cfc tomingnz long 20170313-3 8328 1 R 00:14 mis25/1
421939.m000.cfc tomingnz long 20170313-3 6301 1 R 00:16 mis09/1
421940.m000.cfc tomingnz long 20170313-3 13755 1 R 00:16 mis57/3
421941.m000.cfc tomingnz long 20170313-3 23826 1 R 00:16 mis55/2
421942.m000.cfc tomingnz long 20170313-3 2751 1 R 00:16 mis26/0
421943.m000.cfc tomingnz long 20170313-3 17259 1 R 00:15 mis11/1
421944.m000.cfc tomingnz long 20170313-3 25313 1 R 00:15 mis41/2
421945.m000.cfc tomingnz long 20170313-3 31999 1 R 00:19 mis23/1
421947.m000.cfc tomingnz long 20170313-3 8638 1 R 00:13 mis62/0
421948.m000.cfc tomingnz long 20170313-3 16836 1 R 00:14 mis24/1
421949.m000.cfc tomingnz long 20170313-3 7896 1 R 00:14 mis59/2
421950.m000.cfc tomingnz long 20170313-3 24095 1 R 00:19 mis63/0
421951.m000.cfc tomingnz long 20170313-3 26804 1 R 00:18 mis46/2
421952.m000.cfc tomingnz long 20170313-3 9794 1 R 00:17 mis15/2
421953.m000.cfc tomingnz long 20170313-3 31536 1 R 00:17 mis31/2
421955.m000.cfc tomingnz long 20170313-3 8530 1 R 00:11 mis25/0
421956.m000.cfc tomingnz long 20170313-3 11144 1 R 00:14 mis05/2
421957.m000.cfc tomingnz long 20170313-3 2800 1 R 00:19 mis26/2
421958.m000.cfc tomingnz long 20170313-3 15782 1 R 00:17 mis14/1
421960.m000.cfc tomingnz long 20170313-3 13954 1 R 00:18 mis57/0
421961.m000.cfc tomingnz long 20170313-3 20662 1 R 00:17 mis54/3
421962.m000.cfc tomingnz long 20170313-3 29223 1 R 00:17 mis60/2
421963.m000.cfc tomingnz long 20170313-3 6350 1 R 00:18 mis09/2
421964.m000.cfc tomingnz long 20170313-3 26855 1 R 00:18 mis46/0
421965.m000.cfc tomingnz long 20170313-3 16891 1 R 00:17 mis24/0
421966.m000.cfc tomingnz long 20170313-3 19845 1 R 00:15 mis06/2
421967.m000.cfc tomingnz long 20170313-3 24948 1 R 00:15 mis42/1
421968.m000.cfc tomingnz long 20170313-3 9843 1 R 00:19 mis15/0
421969.m000.cfc tomingnz long 20170313-3 24030 1 R 00:19 mis55/1
422039.m000.cfc tomingnz long 20170313-3 27073 1 R 00:24 mis46/0
422040.m000.cfc tomingnz long 20170313-3 14157 1 R 00:08 mis57/0
422437.m000.cfc tomingnz long 20170313-7 8239 1 R 00:02 mis09/1
422441.m000.cfc tomingnz long 20170313-7 15694 1 R 00:01 mis57/3
422447.m000.cfc tomingnz long 20170313-7 18773 1 R 00:01 mis11/1
422454.m000.cfc tomingnz long 20170313-7 8288 1 R 00:01 mis09/2
422457.m000.cfc tomingnz long 20170313-7 19123 1 R 00:01 mis24/0
422468.m000.cfc tomingnz long 20170313-7 19172 1 R 00:00 mis24/1
422470.m000.cfc tomingnz long 20170313-7 27458 1 R 00:00 mis55/2
422473.m000.cfc tomingnz long 20170313-7 11171 1 R 00:02 mis15/2
422476.m000.cfc tomingnz long 20170313-7 6261 1 R 00:02 mis61/2
422483.m000.cfc tomingnz long 20170313-7 11220 1 R 00:00 mis15/0
422501.m000.cfc tomingnz long 20170313-7 16744 1 R 00:00 mis40/0
422516.m000.cfc tomingnz long 20170313-7 8571 1 R 00:01 mis59/2
422533.m000.cfc tomingnz long 20170313-7 5116 1 R 00:00 mis26/2
422535.m000.cfc tomingnz long 20170313-7 24643 1 R 00:00 mis63/0
422543.m000.cfc tomingnz long 20170313-7 694 1 R 00:01 mis23/1
422550.m000.cfc tomingnz long 20170313-7 3329 1 R 00:02 mis32/2
422557.m000.cfc tomingnz long 20170313-7 9867 1 R 00:03 mis25/0
422558.m000.cfc tomingnz long 20170313-7 9906 1 R 00:03 mis25/1
422561.m000.cfc tomingnz long 20170313-7 29584 1 R 00:01 mis60/2
422566.m000.cfc tomingnz long 20170313-7 9149 1 R 00:00 mis62/0
422583.m000.cfc tomingnz long 20170313-7 16501 1 R 00:01 mis14/1
422605.m000.cfc tomingnz long 20170313-7 19344 1 R 00:00 mis10/2
422721.m000.cfc tomingnz long 20170313-7 2812 1 R 00:12 mis32/1
422722.m000.cfc tomingnz long 20170313-7 2806 1 R 00:12 mis31/1
422723.m000.cfc tomingnz long 20170313-7 2802 1 R 00:12 mis26/1
422724.m000.cfc tomingnz long 20170313-7 2807 1 R 00:12 mis25/1
422725.m000.cfc tomingnz long 20170313-7 2808 1 R 00:12 mis24/1
422726.m000.cfc tomingnz long 20170313-7 2835 1 R 00:12 mis23/1
422727.m000.cfc tomingnz long 20170313-7 2830 1 R 00:12 mis16/1
422731.m000.cfc tomingnz long 20170313-7 2830 1 R 00:12 mis10/1
422738.m000.cfc tomingnz long 20170313-7 2872 1 R 00:12 mis10/2
422742.m000.cfc tomingnz long 20170313-7 2872 1 R 00:12 mis16/2
422743.m000.cfc tomingnz long 20170313-7 2877 1 R 00:12 mis23/2
422744.m000.cfc tomingnz long 20170313-7 2850 1 R 00:12 mis24/2
422745.m000.cfc tomingnz long 20170313-7 2849 1 R 00:12 mis25/2
422746.m000.cfc tomingnz long 20170313-7 2844 1 R 00:12 mis26/2
422747.m000.cfc tomingnz long 20170313-7 2848 1 R 00:12 mis31/2
422748.m000.cfc tomingnz long 20170313-7 2854 1 R 00:12 mis32/2
422758.m000.cfc tomingnz long 20170313-7 2851 1 R 00:12 mis61/2
422759.m000.cfc tomingnz long 20170313-7 2855 1 R 00:12 mis62/2
422760.m000.cfc tomingnz long 20170313-7 2991 1 R 00:12 mis63/2
422761.m000.cfc tomingnz long 20170313-7 2995 1 R 00:12 mis63/3
422762.m000.cfc tomingnz long 20170313-7 2897 1 R 00:12 mis62/3
422772.m000.cfc tomingnz long 20170313-7 2920 1 R 00:00 mis16/3
422776.m000.cfc tomingnz long 20170313-7 3099 1 R 00:01 mis63/2
422777.m000.cfc tomingnz long 20170313-7 3105 1 R 00:01 mis63/3
422778.m000.cfc tomingnz long 20170313-7 2920 1 R 00:00 mis31/2
422791.m000.cfc tomingnz long 20170313-7 2920 1 R 00:00 mis26/2
422805.m000.cfc tomingnz long 20170313-7 2963 1 R 00:00 mis26/1
422808.m000.cfc tomingnz long 20170313-7 2971 1 R 00:02 mis25/1
422812.m000.cfc tomingnz long 20170313-7 3090 1 R 00:02 mis10/1
422816.m000.cfc tomingnz long 20170313-7 3095 1 R 00:02 mis23/1
422817.m000.cfc tomingnz long 20170313-7 3099 1 R 00:02 mis23/2
422821.m000.cfc tomingnz long 20170313-7 3133 1 R 00:00 mis10/2
422825.m000.cfc tomingnz long 20170313-7 3031 1 R 00:00 mis24/1
422826.m000.cfc tomingnz long 20170313-7 3030 1 R 00:00 mis25/1
422828.m000.cfc tomingnz long 20170313-7 3081 1 R 00:00 mis62/2
422829.m000.cfc tomingnz long 20170313-7 3086 1 R 00:00 mis62/3
422831.m000.cfc tomingnz long 20170313-7 3072 1 R 00:00 mis25/2
422832.m000.cfc tomingnz long 20170313-7 3073 1 R 00:04 mis24/2
422836.m000.cfc tomingnz long 20170313-7 3175 1 R 00:02 mis10/3
422840.m000.cfc tomingnz long 20170313-7 3179 1 R 00:02 mis23/3
422847.m000.cfc tomingnz long 20170313-7 3391 1 R 00:02 mis09/2
422848.m000.cfc tomingnz long 20170313-7 3125 1 R 00:01 mis24/1
422852.m000.cfc tomingnz long 20170313-7 3030 1 R 00:02 mis61/2
422856.m000.cfc tomingnz long 20170313-7 3186 1 R 00:02 mis62/2
422865.m000.cfc tomingnz long 20170313-7 3231 1 R 00:02 mis62/3
422870.m000.cfc tomingnz long 20170313-7 3336 1 R 00:01 mis25/1
422871.m000.cfc tomingnz long 20170313-7 3350 1 R 00:01 mis25/2