[oracle@bda03 hama-0.6.0-SNAPSHOT]$ hadoop dfs -ls edward Found 1 items -rw-r--r-- 3 oracle hadoop 1058414409 2012-08-28 22:16 /user/oracle/edward/links-simple-sorted.txt [oracle@bda03 hama-0.6.0-SNAPSHOT]$ bin/hama jar hama-examples-0.6.0-SNAPSHOT.jar pagerank /user/oracle/edward/links-simple-sorted.txt out 12/09/10 18:44:25 INFO bsp.FileInputFormat: Total input paths to process : 1 12/09/10 18:44:25 INFO net.NetworkTopology: Adding a new node: /switch1/192.168.10.3:50010 12/09/10 18:44:25 INFO net.NetworkTopology: Adding a new node: /switch1/192.168.10.5:50010 12/09/10 18:44:25 INFO net.NetworkTopology: Adding a new node: /switch1/192.168.10.16:50010 12/09/10 18:44:25 INFO net.NetworkTopology: Adding a new node: /switch1/192.168.10.14:50010 12/09/10 18:44:25 INFO net.NetworkTopology: Adding a new node: /switch1/192.168.10.15:50010 12/09/10 18:44:25 INFO net.NetworkTopology: Adding a new node: /switch1/192.168.10.8:50010 12/09/10 18:44:25 INFO net.NetworkTopology: Adding a new node: /switch1/192.168.10.11:50010 12/09/10 18:44:25 INFO bsp.FileInputFormat: Total # of splits: 17 12/09/10 18:44:25 INFO bsp.BSPJobClient: Running job: job_201209101841_0002 12/09/10 18:44:28 INFO bsp.BSPJobClient: Current supersteps number: 2 12/09/10 18:44:31 INFO bsp.BSPJobClient: Current supersteps number: 8 12/09/10 18:44:34 INFO bsp.BSPJobClient: Current supersteps number: 16 12/09/10 18:44:37 INFO bsp.BSPJobClient: The total number of supersteps: 16 12/09/10 18:44:37 INFO bsp.BSPJobClient: Counters: 10 12/09/10 18:44:37 INFO bsp.BSPJobClient: org.apache.hama.bsp.JobInProgress$JobCounter 12/09/10 18:44:37 INFO bsp.BSPJobClient: LAUNCHED_TASKS=17 12/09/10 18:44:37 INFO bsp.BSPJobClient: org.apache.hama.bsp.BSPPeerImpl$PeerCounter 12/09/10 18:44:37 INFO bsp.BSPJobClient: SUPERSTEPS=16 12/09/10 18:44:37 INFO bsp.BSPJobClient: SUPERSTEP_SUM=272 12/09/10 18:44:37 INFO bsp.BSPJobClient: COMPRESSED_BYTES_SENT=802984424 12/09/10 18:44:37 INFO bsp.BSPJobClient: TIME_IN_SYNC_MS=13996 12/09/10 18:44:37 INFO bsp.BSPJobClient: IO_BYTES_READ=1058414409 12/09/10 18:44:37 INFO bsp.BSPJobClient: COMPRESSED_BYTES_RECEIVED=802984424 12/09/10 18:44:37 INFO bsp.BSPJobClient: TOTAL_MESSAGES_SENT=11412446 12/09/10 18:44:37 INFO bsp.BSPJobClient: TASK_INPUT_RECORDS=5706070 12/09/10 18:44:37 INFO bsp.BSPJobClient: TOTAL_MESSAGES_RECEIVED=5706223 Job Finished in 12.322 seconds
PageRank with Apache Hama
The dataset contains 5,716,808 pages and 130,160,392 links and is unzipped ~1gb large.
Subscribe to:
Post Comments (Atom)
-
Opening the black box of Deep Neural Networks via Information - https://arxiv.org/pdf/1703.00810.pdf 지금까지 딥 러닝은 어떻게 동작하는지 이해할 수 없다고 믿어져왔다...
-
음성 인공지능 분야에서 스타트업이 생각해볼 수 있는 전략은 아마 다음과 같이 3가지 정도가 있을 것이다: 독자적 Vertical 음성 인공지능 Application 구축 기 음성 플랫폼을 활용한 B2B2C 형태의 비지니스 구축 기 음성 플랫폼...
-
As mentioned ago, I've been forming up the Hamburg project with Hyunsik Choi. Let's see more detail in the diagram of computing met...
No comments:
Post a Comment