Jump to content




ComputerCraft Benchmarking (Emulators and Minecraft)


31 replies to this topic

#1 GravityScore

  • Members
  • 796 posts
  • LocationLand of Meh

Posted 02 February 2014 - 09:18 AM

Hey all,

1lann wrote a quick, cheap, little script to benchmark ComputerCraft (as in, output a number grading it on how well it performs).

Please note the results will vary depending on your computer.

The results are extremely interesting. For the top numbers above the line, the lower the number is, the better it performed. For the total score at the bottom, the higher the number, the better it performed.

First up, ComputerCraft 1.58 running in Minecraft:
Posted Image


This is the most interesting one. ComputerCraft Beta 1.6pr0 running in Minecraft. Looks like the new windowing API slows it down dramatically. The negative score at the bottom basically means it took longer than a minute to complete.
Posted Image


Next up is my own ComputerCraft emulator Mimic. This is the old version in C++ running ComputerCraft 1.53:
Posted Image


Here is the new version of Mimic (running ComputerCraft 1.58) written in Javascript:
Posted Image


And here is CCEmu (can't believe I still have a version) running I have no idea what version of ComputerCraft:
Posted Image


If you've got a version of ComputerCraft, or want to test another emulator (I can't find a proper version of Love to run Sorroko's emulator), just run the script linked above and please post the results!

Edited by GravityScore, 02 February 2014 - 09:35 AM.


#2 Engineer_Nalfar

  • Members
  • 12 posts

Posted 02 February 2014 - 09:40 AM

If you are intersected here is results from my testing. Out of curiosity what stats is your PC ?
Spoiler

Edited by Engineer_Nalfar, 03 February 2014 - 04:53 AM.


#3 GravityScore

  • Members
  • 796 posts
  • LocationLand of Meh

Posted 02 February 2014 - 06:39 PM

View PostEngineer_Nalfar, on 02 February 2014 - 09:40 AM, said:

If you are intersected here is results from my testing. Out of curiosity what stats is your PC ?

I'm using a Intel Core i7 2.7GHz, 16GB 1600MHz DDR3, Intel HD Graphics 4000 1GB, Mac OSX, Java 6, Minecraft 1.6.4.

#4 nutcase84

  • Members
  • 711 posts
  • LocationIn My Lonely Little Computer Corner

Posted 02 February 2014 - 06:52 PM

Why Java 6?

#5 Bomb Bloke

    Hobbyist Coder

  • Moderators
  • 7,099 posts
  • LocationTasmania (AU)

Posted 02 February 2014 - 09:54 PM

View PostEngineer_Nalfar, on 02 February 2014 - 09:40 AM, said:

If you are intersected here is results from my testing.
No CC version...?

#6 awsmazinggenius

  • Members
  • 930 posts
  • LocationCanada

Posted 02 February 2014 - 11:08 PM

Here is CCLite (Sorroko's version) 2.10 (CC 1.6 pr0 beta version of it):
Posted Image
PC (Just my laptop that I use for light internet surfing):
Intel® Core™ i5-3350P CPU @ 3.10GHz

8.0 GB DDR3 Memory

Windows 8.1

#7 gamax92

  • Members
  • 157 posts

Posted 02 February 2014 - 11:19 PM

Lotsa images - Tests done on an AMD Phenom II X2 545 @ 3.51GHz, Windows 7 32-bit
Spoiler

Edited by gamax92, 02 February 2014 - 11:22 PM.


#8 surferpup

  • Members
  • 286 posts
  • LocationUnited States

Posted 03 February 2014 - 01:37 AM

Neat utility.

My new MacBook Pro gets the following:

Text Rendering: 1.5
Color Rendering: 1.7
Advanced Rendering 3.0
Computing Power: 2.5

Total (out of 50): 46.3


You should post this in utilities.

#9 oeed

    Oversimplifier

  • Members
  • 2,095 posts
  • LocationAuckland, New Zealand

Posted 03 February 2014 - 02:15 AM

This looks really interesting. Nice to see that the latest Mimic is pretty much the fastest of them all. Out of curiosity, why didn't 1lann post it if he made it?

View Postnutcase84, on 02 February 2014 - 06:52 PM, said:

Why Java 6?
OS X and Java have a strange relationship. You generally can't use the version you want, it's sh•t or nothing.

Edited by oeed, 03 February 2014 - 02:15 AM.


#10 ingie

  • Members
  • 69 posts
  • LocationMannin

Posted 03 February 2014 - 02:30 AM

GNU/Linux Ubuntu 13.10
Oracle Java 7
i5 @ 3.00Ghz
8Gb Ram [ 2gb Java ]
NVidia GeForce GTS 450
Direwolf20 Modpack for 1.64 CC 1.57 / OP snap 112 / OCCS 1.6.4.1b

i also have my terminal size set to 29x81
Attached Image: Screenshot from 2014-02-03 07:25:24.png

- i note that on a 3x3 colour monitor attached and running the benchmark on that, the score is much better... a 4x5 monitor, much worse... running a max size monitor on top i get a total of 27.1

on my 2007 macbook pro [ core 2 duo, 4gb, nvidia something, java 6 ] i get an overall score of -9.8 ... mind you, the same modpack runs at about 20FPS on it, so...

Edited by ingie, 03 February 2014 - 03:16 AM.


#11 GravityScore

  • Members
  • 796 posts
  • LocationLand of Meh

Posted 03 February 2014 - 03:19 AM

View Postoeed, on 03 February 2014 - 02:15 AM, said:

Out of curiosity, why didn't 1lann post it if he made it?

He didn't think anyone would be interested, so I said I'd do it for him if he didn't want to :P

#12 oeed

    Oversimplifier

  • Members
  • 2,095 posts
  • LocationAuckland, New Zealand

Posted 03 February 2014 - 03:30 AM

View PostGravityScore, on 03 February 2014 - 03:19 AM, said:

View Postoeed, on 03 February 2014 - 02:15 AM, said:

Out of curiosity, why didn't 1lann post it if he made it?

He didn't think anyone would be interested, so I said I'd do it for him if he didn't want to :P

Ah I see :P

#13 Engineer_Nalfar

  • Members
  • 12 posts

Posted 03 February 2014 - 04:53 AM

View PostBomb Bloke, on 02 February 2014 - 09:54 PM, said:

View PostEngineer_Nalfar, on 02 February 2014 - 09:40 AM, said:

If you are intersected here is results from my testing.
No CC version...?
fixed

#14 oeed

    Oversimplifier

  • Members
  • 2,095 posts
  • LocationAuckland, New Zealand

Posted 03 February 2014 - 05:04 AM

View PostGravityScore, on 02 February 2014 - 09:18 AM, said:

This is the most interesting one. ComputerCraft Beta 1.6pr0 running in Minecraft. Looks like the new windowing API slows it down dramatically. The negative score at the bottom basically means it took longer than a minute to complete.
Posted Image

Now I think of it, you might want to mention this in the bug reports post.

#15 Wojbie

  • Members
  • 631 posts
  • LocationKinda lost

Posted 03 February 2014 - 05:27 AM

View Postoeed, on 03 February 2014 - 05:04 AM, said:

Spoiler
Now I think of it, you might want to mention this in the bug reports post.

It could be effect of all the debug code that probably got left inside this version. I don't think any changes could make this kind of difference.

Edited by wojbie, 03 February 2014 - 05:27 AM.


#16 GravityScore

  • Members
  • 796 posts
  • LocationLand of Meh

Posted 03 February 2014 - 07:53 AM

View Postwojbie, on 03 February 2014 - 05:27 AM, said:

It could be effect of all the debug code that probably got left inside this version. I don't think any changes could make this kind of difference.

I was thinking it was due to the window API that all drawing in advanced computers is now wrapped in. Because this is Lua side it would likely be much slower than Java side, probably causing the terrible slowness.

#17 H4X0RZ

  • Members
  • 1,315 posts
  • LocationGermany

Posted 03 February 2014 - 08:00 AM

I think I just broke the program xDD
Posted Image

#EDIT:

Specs

This is the output of "lspci" on my Ubuntu 13.10 :)

#EDIT2:

Tested on
gamax92's emulator. Wonderful program btw :D

Edited by Freack100, 03 February 2014 - 08:13 AM.


#18 nutcase84

  • Members
  • 711 posts
  • LocationIn My Lonely Little Computer Corner

Posted 03 February 2014 - 08:25 AM

View Postoeed, on 03 February 2014 - 02:15 AM, said:

This looks really interesting. Nice to see that the latest Mimic is pretty much the fastest of them all. Out of curiosity, why didn't 1lann post it if he made it?

View Postnutcase84, on 02 February 2014 - 06:52 PM, said:

Why Java 6?
OS X and Java have a strange relationship. You generally can't use the version you want, it's sh•t or nothing.

Hmm... my old macbook worked fine with 7... but I can relate because my PowerBook hated openJRE or whatever it's called. XD

#19 oeed

    Oversimplifier

  • Members
  • 2,095 posts
  • LocationAuckland, New Zealand

Posted 03 February 2014 - 03:34 PM

Well, I don't have a screenshot because it never actually finished. But I tried running it in my OS...

Let's just say 30 minutes in it was still doing the colour test. I think I might need to look in to some optimisation.

#20 ingie

  • Members
  • 69 posts
  • LocationMannin

Posted 03 February 2014 - 03:49 PM

View Postnutcase84, on 03 February 2014 - 08:25 AM, said:

View Postoeed, on 03 February 2014 - 02:15 AM, said:

This looks really interesting. Nice to see that the latest Mimic is pretty much the fastest of them all. Out of curiosity, why didn't 1lann post it if he made it?

View Postnutcase84, on 02 February 2014 - 06:52 PM, said:

Why Java 6?
OS X and Java have a strange relationship. You generally can't use the version you want, it's sh•t or nothing.

Hmm... my old macbook worked fine with 7... but I can relate because my PowerBook hated openJRE or whatever it's called. XD

both is true.
apple used to write their own JRE until after 1.6 when they handed over responsibility to Oracle/ Users to install their own choice - mainly because the support of the JRE was annoying them as it was allowing a malware infection vector on OSX... so up until OS X 10.7.3 you had no choice and had to use the Apple one ... after that, you can use the Oracle one here... i've not upgraded tho as it was such a pain to get the RXTX serial library working that i daren't touch it :)


back on track: i ran the benchmark on my home server instance, it crashed the server... :(
- out of memory
so i adjusted the java params and tried again... 9.5 :(
mind you, it was raining in game at the time... but i could hear the other computers fans speed up as soon as i hit enter on the benchmark :)

edit: interesting: 23 when it's not raining.

this server is only a core2 duo 2.something ghz with 4gb - 1.5 for java - but it's running a headless linux install [no window system] to keep it's overheads down...

i'm tempted to install MineOS or similar [anyone any experience with it, is it worth it?] - to really take it to a bare bones install, if i do, i'll do the same test and post here...

Edited by ingie, 03 February 2014 - 03:55 PM.






1 user(s) are reading this topic

0 members, 1 guests, 0 anonymous users