Create an account

Very important

  • To access the important data of the forums, you must be active in each forum and especially in the leaks and database leaks section, send data and after sending the data and activity, data and important content will be opened and visible for you.
  • You will only see chat messages from people who are at or below your level.
  • More than 500,000 database leaks and millions of account leaks are waiting for you, so access and view with more activity.
  • Many important data are inactive and inaccessible for you, so open them with activity. (This will be done automatically)


Thread Rating:
  • 224 Vote(s) - 3.38 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Java framework/tool for simple distributed computing problem

#1
We generate pdf files with data regarding monthly financial balance of tens of thousands of clients. At it's peak (100.000 files at the end of year), the process may take as long as 5 days to complete using distribute the load between 5 servers. The distribution of workload is a manual process (eg. server 1 generates pdf for clients 1 to 20.000, server 2 from 20.001 to 40.000, and so on).

We use Java, so we would like to use a Java tool or framework in a fashion similar to [BOINC](

[To see links please register here]

) (BOINC is not coded in Java), which would allow us to have:

- a server automatically distributing data and code to workers, and managing them
- workers (plain dual core desktops using free (or not so) cpu cycles) receiving code sent by server and executing it using the data as input, giving some status feedback, and finally doing something with the output, eg. sending pdf generated files to network storage.

For now, we don't want to try heavyweight all-powerful toolkits such as Globus Toolkit.

¿Do you know any java framework/tools suitable to our needs? Open source would be nice, but we don't discard commercial solutions.
Reply

#2
-

[To see links please register here]

-

[To see links please register here]

-

[To see links please register here]

Reply

#3
Another one you can look at is [Terracotta][1].


[1]:

[To see links please register here]

Reply

#4
Google says there is a Java port of BOINC here:

[To see links please register here]


It's mostly targeting about android :-/ but apparently all but the GUI can run on a regular VM.
Reply

#5
There are many:

-

[To see links please register here]

-

[To see links please register here]

-

[To see links please register here]

-

[To see links please register here]


Google is your best friend here.
Reply

#6
Check out [Hazelcast distributed executor service][1]. It uses Java's standard ExecutorService API.


[1]:

[To see links please register here]

Reply



Forum Jump:


Users browsing this thread:
1 Guest(s)

©0Day  2016 - 2023 | All Rights Reserved.  Made with    for the community. Connected through