PageRank with Apache Hama

The dataset contains 5,716,808 pages and 130,160,392 links and is unzipped ~1gb large. 
[oracle@bda03 hama-0.6.0-SNAPSHOT]$ hadoop dfs -ls edward
Found 1 items
-rw-r--r--   3 oracle hadoop 1058414409 2012-08-28 22:16 /user/oracle/edward/links-simple-sorted.txt

[oracle@bda03 hama-0.6.0-SNAPSHOT]$ bin/hama jar hama-examples-0.6.0-SNAPSHOT.jar pagerank /user/oracle/edward/links-simple-sorted.txt out
12/09/10 18:44:25 INFO bsp.FileInputFormat: Total input paths to process : 1
12/09/10 18:44:25 INFO net.NetworkTopology: Adding a new node: /switch1/192.168.10.3:50010
12/09/10 18:44:25 INFO net.NetworkTopology: Adding a new node: /switch1/192.168.10.5:50010
12/09/10 18:44:25 INFO net.NetworkTopology: Adding a new node: /switch1/192.168.10.16:50010
12/09/10 18:44:25 INFO net.NetworkTopology: Adding a new node: /switch1/192.168.10.14:50010
12/09/10 18:44:25 INFO net.NetworkTopology: Adding a new node: /switch1/192.168.10.15:50010
12/09/10 18:44:25 INFO net.NetworkTopology: Adding a new node: /switch1/192.168.10.8:50010
12/09/10 18:44:25 INFO net.NetworkTopology: Adding a new node: /switch1/192.168.10.11:50010
12/09/10 18:44:25 INFO bsp.FileInputFormat: Total # of splits: 17
12/09/10 18:44:25 INFO bsp.BSPJobClient: Running job: job_201209101841_0002
12/09/10 18:44:28 INFO bsp.BSPJobClient: Current supersteps number: 2
12/09/10 18:44:31 INFO bsp.BSPJobClient: Current supersteps number: 8
12/09/10 18:44:34 INFO bsp.BSPJobClient: Current supersteps number: 16
12/09/10 18:44:37 INFO bsp.BSPJobClient: The total number of supersteps: 16
12/09/10 18:44:37 INFO bsp.BSPJobClient: Counters: 10
12/09/10 18:44:37 INFO bsp.BSPJobClient:   org.apache.hama.bsp.JobInProgress$JobCounter
12/09/10 18:44:37 INFO bsp.BSPJobClient:     LAUNCHED_TASKS=17
12/09/10 18:44:37 INFO bsp.BSPJobClient:   org.apache.hama.bsp.BSPPeerImpl$PeerCounter
12/09/10 18:44:37 INFO bsp.BSPJobClient:     SUPERSTEPS=16
12/09/10 18:44:37 INFO bsp.BSPJobClient:     SUPERSTEP_SUM=272
12/09/10 18:44:37 INFO bsp.BSPJobClient:     COMPRESSED_BYTES_SENT=802984424
12/09/10 18:44:37 INFO bsp.BSPJobClient:     TIME_IN_SYNC_MS=13996
12/09/10 18:44:37 INFO bsp.BSPJobClient:     IO_BYTES_READ=1058414409
12/09/10 18:44:37 INFO bsp.BSPJobClient:     COMPRESSED_BYTES_RECEIVED=802984424
12/09/10 18:44:37 INFO bsp.BSPJobClient:     TOTAL_MESSAGES_SENT=11412446
12/09/10 18:44:37 INFO bsp.BSPJobClient:     TASK_INPUT_RECORDS=5706070
12/09/10 18:44:37 INFO bsp.BSPJobClient:     TOTAL_MESSAGES_RECEIVED=5706223
Job Finished in 12.322 seconds

Comments

Post a Comment

Popular posts from this blog

μΌλ³Έλ§Œν™” μΆ”μ²œ 100μ„ 

1.ꡰ계 (μ•‘μ…˜,격투)

κ²©νˆ¬λ§Œν™” μ€‘μ—μ„œλŠ” μ•„μ£Ό 유λͺ…ν•˜κ³  μ—΄κ΄‘μ μœΌλ‘œ μ’‹μ•„ν•˜λŠ” μ‚¬λžŒμ΄ λ§Žμ€ λ§Œν™”μž…λ‹ˆλ‹€. μ „μ²΄μ μœΌλ‘œ λ§Œν™”μ˜ λΆ„μœ„κΈ°λŠ” μ–΄λ‘‘κ³ μš”... 쀄거리λ₯Ό μ†Œκ°œν•˜μ£ . 주인곡인 λ£ŒλŠ” λͺ¨λ²”μƒμ΄μ—ˆμŠ΅λ‹ˆλ‹€. κ·ΈλŸ¬λ‚˜ λΆ€λͺ¨λ‹˜μ˜ 강압적인 ν†΅μ œ... 그에 λŒ€ν•œ λ¬΄μ˜μ‹μ  반발둜 λΆ€λͺ¨λ‹˜μ„ μ‚΄ν•΄ν•˜κ²Œ 되고 λ§™λ‹ˆλ‹€. 그리고 κ΅λ„μ†Œμ—μ„œ λ§Žμ€ λ³€ν™”λ₯Ό κ²ͺ게되죠..그리고 μ•…μ˜ 화신같은 μ‘΄μž¬κ°€ 되고 말죠..... 또 그에 λŒ€ν•­ν•˜λŠ” 인물이 λ‚˜νƒ€λ‚˜κ³ .... λ§Œν™”μ— λŒ€ν•œ μ†Œκ°œκ°€ λ§Œν™”μ˜ μ§ˆμ„ λͺ» λ”°λΌκ°€λ„€μš”. 이 λ§Œν™”λŠ” μ„ κ³Ό 악에 λŒ€ν•΄ 생각해볼 μˆ˜μžˆλŠ” λ§Œν™”μž…λ‹ˆλ‹€. 그리고 μ‹Έμ›€μ΄λž€ μΈκ°„μ—κ²Œ μ–΄λ–€ μ˜λ―Έκ°€ μžˆλŠ”κ²ƒμΌκΉŒ? ν•˜λŠ” μƒκ°λ„μš”. μ•„..κ΅°κ³„λŠ” μ‹Έμ›€λ‹­μ΄λž€ λœ»μž…λ‹ˆλ‹€. λ„€μ΄λ°μ„ΌμŠ€κ°€ μ’‹μ£ .


2. 생좔어리(ν•΄μ νŒμ œλͺ©:λΉ›κ³Ό 그림자) (μ•‘μ…˜,μ •μΉ˜)

일본 졜고의 극화체 λ§Œν™”κ°€μΈ 이케가미 λ£Œμ΄μΉ˜λ‹˜μ˜ μž‘ν’ˆμž…λ‹ˆλ‹€. μΊ„λ³΄λ””μ•„μ—μ„œ 일본 μ™Έκ΅κ΄€μ˜ μ•„λ“€λ‘œ νƒœμ–΄λ‚œ 두 λ‚¨μž 이야기λ₯Ό 그리고 μžˆμŠ΅λ‹ˆλ‹€. μΊ„λ³΄λ””μ•„μ˜ ν‚¬λ§ν•„λ“œ(λŒ€ν•™μ‚΄..μ‹€μ‘΄μ‚¬κ±΄μž…λ‹ˆλ‹€.)μ™€μ€‘μ—μ„œ 살아남아 λŒμ•„μ˜¨ 두 주인곡..ν•œλͺ…은 암흑계 보슀둜 λ‹€λ₯Έ ν•œ λͺ…은 μ •μΉ˜κ³„ 거물둜 μ„±μž₯ν•΄κ°‘λ‹ˆλ‹€. 두 λ‚¨μžμ˜ λͺ©μˆ¨κ³Όλ„ 같은 μš°μ •....κ·Έλ“€μ˜ κ΄€κ³„λŠ” μ–΄λ–»κ²Œ 될까? λ›°μ–΄λ‚œ μŠ€ν† λ¦¬μž‘κ°€μ™€ 항상 μž‘μ—…ν•˜μ—¬ μž¬λ―ΈλŠ” 보μž₯이 λ˜λŠ” μž‘ν’ˆμž…λ‹ˆλ‹€. 단 λ‚¨μ„±μš°μ›”μ£Όμ˜κ°€ μž‘ν’ˆμ „λ°˜μ— κΉ”λ €μžˆμ–΄μ„œ 여성이 보기엔 거뢀감을 λŠλ‚„μˆ˜λ„ μžˆλŠ” μž‘ν’ˆ..λ‚¨μžλΆ„μΈκ±° κ°™μ•„ μΆ”μ²œν•©λ‹ˆλ‹€.


3.수라의 각 (역사,λ¬΄ν˜‘)

ν•΄ν™©κΈ°μ˜ μž‘κ°€κ°€ μ“΄ 맀우 ν₯λ―Έμ§„μ§„ν•œ 역사 λ¬΄ν˜‘λ¬Όμž…λ‹ˆλ‹€. 일본 μ—­μ‚¬μ†μ˜ λ§Žμ€ μ‹€μ‘΄μΈλ¬Όλ“€μ˜ μ–˜κΈ°λ₯Ό κΈ°λ‘₯μ€„κ±°λ¦¬λ‘œ ν•˜μ—¬ 거기에 ν—ˆκ΅¬λ₯Ό μž‘κ°€μ˜ λŠ₯수λŠ₯λž€ν•œ μ†œμ”¨λ‘œ μ„žμ–΄λƒ…λ‹ˆλ‹€. 이 μž‘ν’ˆμ€ μ½”λ―Ή λ§Œν™”μΈ μˆ˜ν—˜μ˜ μ œμ™•μ—λ„ λ“±μž₯ν•˜λŠ” λ°μš”....κ·Έ λ§Œν™”μ— 이런 말이 μžˆμ§€μš”. "역사 곡뢀λ₯Ό ν•˜λ €κ±°λ“  수라의 각을 읽어라" 이 λ§Œν™”μž‘κ°€μ˜ λ‹€λ₯Έ μž‘ν’ˆμΈ 해황기도 맀우 ν₯λ―Έμ§„μ§„ν•˜λ‹΅λ‹ˆλ‹€.


4.λ² λ₯΄μ„Έλ₯΄ν¬ (νŒνƒ€μ§€)

말이 ν•„μš”μ—†λŠ” νŒνƒ€μ§€μ˜ 졜고 κ±Έμž‘.... λ›°μ–΄λ‚œ μž‘ν™”μ— 철학적인 μ‚¬μœ κΉŒμ§€ λ°°μ–΄λ“  졜고의 μž‘ν’ˆ. μ•ˆ μ½μœΌμ…¨λ‹€λ©΄ λΆ€λ”” μ½μ–΄λ³΄μ‹œκΈΈ..


5.…
Read more

κ²½ν¬λŒ€ κ°•μ—°μžλ£Œ

학생듀 λŒ€μƒμ΄λΌ .. λ‚΄ 인생은 μ΄λž¬λ…ΈλΌ 전달해주며 λ„μ›€λ λ§Œν•œ 그리고 쑰금 λœ¨κ±°μ›Œμ§€λ„λ‘ μžκ·Ήλ°›μ„ λ§Œν•œ λ‚΄μš©μ„ μ μ—ˆλ‹€. SWλ₯Ό 10λ…„ 이상 ν–ˆμ§€λ§Œ ν• λ§Œ ν•œκ±΄μ§€λŠ” λ‚˜λ„ 잘 λͺ¨λ₯΄κ² μŒ.
Read more