can I run apache storm without install python? - bigdata

I am going to test Apache storm for my personal project.
However I don't want to include python support,
is that possible?

There is no need to have python in order to start working with Storm. You can just follow basic tutorial and start playing with it with pure java.
However it does support non jvm based language with is implemented via the ShellBolt class. but that should not be a constraints for learning storm.

Related

In Robot Framework, which is better to create custom library java or python

I know java language very well, i created custom library in java.
while executing i am using jybot to execute the scripts.
When i am running the scripts have Oracle Database Connection, got few errors like cx_oracle is not found, but i ran the same script with pybot option i got no errors.
I understood that when i execute the script using jybot, the verification of folders for prerequisites is different.
I want to know, which is better or have more functions to create our custom library java or python.
I want to know the difference between jybot and pybot when it comes to the execution of scripts.
There are three questions you are asking:
1. What is the difference between pybot (python) and robot on Jython.
2. What is the better approach for developing custom libraries.
3. What causes my Oracle problems.
For question 1 the answer is that in principle the same core code is running for robot running on Python as well as within Jython. So in that sense this shouldn't matter much. However, as most people are running the pure Python flavour this version would probably be the better version from a support perspective. That said, if you and your colleagues are more comfortable with Java, then this may be the better option for you.
Regarding question 2. This follows the same line as the answer for 1. If you feel more comfortable with Java, then this should be fine. However, since robot at the core is a Python application (even on Jython) it makes more sense to run this version. This has also been asked before and a tutorial about the Remote Library approach also good to read. In any case the official documentation holds great examples as well.
For your last question. Please provide us with more details, or better yet; create a new question for it.

NSS DTLS sample application codes

Is there sample standalone "application" codes of utilizing NSS DTLS/SRTP features somewhere available?
There are sample application codes of cmd & tests that utilize SSL3/TLS features that come with NSS Mozilla releases, but none for DTLS features - though there is DTLS support in nss/lib/ssl/ codes, but those are to SSL3/DTLS internal working.
I have tried googling for days but to no avail. I've been trying for a couple of weeks to write codes to access those internal codes, which requires quite a lot hacking to create internal hooks in ssl/ directory, which I think is not the right approach and not going well. But I simply can't find a reasonable API, in dtlscon.c, ssl3con.c and etc., for application to use or a sample app to follow.
Could someone provide some hints or a sample standalone client/server application codes that actually utilize the NSS DTLS/SRTP features?
I'm doing the coding in C under NSS cmd/tests or JAVA under nss/jss/org/Mozilla/jss.
Thanks,

Unit testing postgres database tools

Which is the best tool for postgresql testing ?
I am newly placed in a company where my role is this. I want to know some info regarding tools.
I don't know if you are still looking for a testing suite. I am facing the same problem as you were and found a couple of testing suites on Wikipedia.
Looks like only pgTAP is still actively developed. To me it seems to have a steep learning curve but I think in the long run it will pay to use such a tool for automated testing.
Here is a new one on GitHub called Plpgunit.
https://github.com/mixerp/plpgunit/
Plpgunit does not require any additional dependencies and is ready to
be used on your PostgreSQL Server instance.
To install this framework, you will have to run the SQL script file. So, it seems easy to give a try.

OSGi for non-java 3PPs

We are building a product that uses the apache hadoop & hbase frameworks for handling some of our big data requirements. We are also using Oracle for our reporting requirements. We are keen to go with the OSGi way of bundling our software to take advantage of the remote deployment,service management & loosely coupled packaging features that OSGi containers offer.
We have a few doubts in this area:
When it comes to our own Java apps, we now know how to create OSGi bundles out of them and deploy them over OSGi containers. But how do we handle Java based 3PPs that have a clustered architecture, for example HBase/Hadoop? We saw that Fuse Fabric has created a Hadoop (actually only HDFS not Map Reduce) bundle, but in general how do you go about creating bundles for 3PP's?
How do we handle non-java based 3PPs like for example Oracle. Should we create a OSGi bundle for it and deploy over OSGi or should we install these 3PP's outside of OSGi and write some monitoring scripts that are triggered over OSGi to track the status of these 3PP's? What are the best practices in this area?
Are all bundles launched over OSGi container (like Karaf) run within the same single JVM of the container? Some of our applications and 3PPs are huge and we may run into heap/GC issues if all of them are run inside a single JVM. What are the best practices here?
Thanks & Regards
Skanda
Creating bundles from non-OSGi libraries can be as simple as repackaging it with an appropriate manifest (there are tools for that, see below), but it can also become very difficult. OSGi has a special class-loading model, and many Java EE libraries that do dynamic class-loading don't play well with that.
I am not sure what you mean here. Theoretically OSGi supports loading native libraries using the Bundle-NativeCode manifest-header, but I have no experience with that.
Normally all bundles are run in the same virtual machine. However, Karaf supports clustering through Cellar, I don't know about other containers though.
Tools for wrapping 3rd-party libraries
In general you can use bnd for this (the tool of choice when it comes to automated generation of OSGi-bundle manifests). PAX-URL offers the wrap protocol-handler, which is present by default in Karaf. Using that, wrapping a library can be as simply as that (e.g. from the Karaf-command line, or a feature-descriptor):
wrap:file:path/to/library
The case of Oracle and most other db libs is simple. You can use the wrap protocol of pax url. Unter the covers it uses bnd with default options. I have a tutorial for using dbs with Apache Karaf.
In general making bundles out of third party libs can range from easy to quite complicated. It mainly depends on how much dirty classloading tricks the lib uses. Before you try to bundle stuff yourself you should look if there are ready made bundles. Most libs today either come directly as bundles or are already available as bundles from some source. For example the servicemix project creates a lot of bundles. You can ask on the user list there if something is available.

Maven - which projects or techologies you are using it for?

I've been leading rather large project that strives to "Mavenize" various testing apps produced by the engineering tools group over past 5+ years to test and optimize our home-built database. So far our group managed to successfully retrofit (beside obvious Java) few Coldfusion-based apps, PHP app, large .NET app with about 30 modules and currently working on roughly 40 C/C++ apps. Actually, once you abstract yourself from Java-centric nature of Maven and throw in few useful plugins such as antrun, exec, assembler and resource you can pretty much figure out way of "Mavenizing" just about anything.
So my question is - are there people who had this sort of experience - using Maven to manage non-Java projects? What was it? What language/technology? What did you end up using? How? Were you successful? And if not - what did you end up using as alternative?
Conceptually, Maven is not Java centric but Java is monopolizing most efforts as written on Wikipedia:
Theoretically, [Maven's plugin-based architecture] would allow anyone to write plugins to interface with build tools (compilers, unit test tools, etc.) for any other language. In reality, support and use for languages other than Java has been minimal.
Having that said, I don't have any personal experience of maven with something else than Java. But I can suggest to check out Maven for other languages? :)
We're using Maven to build a Flex application, and it's working quite nicely :).
I have used maven for generating documentation based on LaTeX source files. Using exec and some wrapper scripts, I can create PDF files and handle SCM releases.
One of the PDF files generated is included in a web app by letting maven package it into a jar file, which is referenced from the web app as a regular dependency. The web app can then access the PDF file on the class path.

Resources