I am trying to consume messages from a remote kafka and produce output to a local kafka setup.
Additionally I don't want to 'pollute' the remote Kafka with kakfa streams specific technical topics (e.g. intermediate KTable stores).
I created an example app for demo purposes, however this doesn't work as expected - and I cannot say why.
Not working means: I don't really understand what's going on. Multiple consumers are being created but all to locahost, none seems to point to the remote kafka.
https://github.com/webermich/multibinder
https://github.com/webermich/multibinder/blob/main/src/main/resources/application.yaml
So my qustions are:
Is my general understanding correct that I can build something like I described above?
If the answer to 1) is true: Can anyone spot my mistakes?
I am really unsure about the type: kstream of my bindings, too. I feel this is wrong.
Is there a link to a working example?
Related
We are working with Opsview 6. I would like to insert a passive check result into the monitoring server remotely. The documentation is very vague about this, saying that it can be done via the API (no reference to this in the API docs), and that it is a part of the results forwarder. I don't see any open ports related to the results forwarder, so there must be something that needs to run to accept input somewhere, I'm just clueless what that might be. I'm willing to work with NSCA, NRD, or the API. Whatever works.
I have gone through some material, talks and some documentation on rocksdb.
I find it interesting for some use cases. I would like to understand how it can be used to populate data using message queues like AMQP, ZMQ or Kafka.
I've not gone through individual files on github, in case there is any explanation on this.
Request you to share your thoughts/experiences on the same.
Thanks
I am newbie to Spring framework and Spring Integration. As I went through Spring documentation http://docs.spring.io/spring-integration/reference/html/ip.html. I found hard to start. I would like to get the step by step procedure to write an application. Writing from *.xml file, running it, editing the stubs and working on the same.
Although I can see a lot of examples showing TCP /UDP client and server, for a newbie like me, its difficult.
Thanks in advance,
Velman R
See the tcp-client-server sample app that shows the use of both inbound and outbound gateways to invoke an echo service over TCP.
It uses the default CRLF to delimit messages; be sure to read the section about (de)serializers in the documentation.
I am new to BizTalk. I got a requirement as below.
Requirement is below:-
Source: Oracle (table). I created a generated schema in BizTalk.
Target: Webservice which receives "object array" (Table of source records from BizTalk) as an input.
Source and Target systems have same structure. Hence no mapping should be implemented. Logic should be in pipelines or orchestration.
Need info on below two topics:
How to incorporate the logic in pipeline or orchestration to map data from source schema to target WS schema.
This question was posed (now deleted) on the other big BizTalk forum. So I'll share my answer here.
What you're asking is simply not possible. It doesn't matter that the source and destination are logically the same. They are represented by two different schemas in BizTalk. There is no way around this except by developing the Web Service to accept the WCF Oracle message directly.
Because of that, you must transform from the source to the destination. Maps are how that is done. While there are technically other ways, they are harder to write, bug prone and would likely offer a less desirable performance profile.
A ban on Maps is just counter-productive and as a long time BizTalk Developer I could not accept a project with such a requirement.
It's not very clear what you are asking for to be honest. Your requirement states that no mapping is required, but then you go on to ask how to incorporate mapping in pipeline or orchestrations.
A standard approach to delivering this would be;
Setup your input process from Oracle by using "Consume Adapter
Service" from visual studio's "add generated item". Use the oracle
binding, setup connection properties for typed polling along with
your query (see here for an example on MS SQL) change to a
service contract type (for inbound operations) and you'll get a set
of schemas representing your dataset, and a binding for your type
receive port poller.
Use "Consume WCF Service" to point to your "sending" web service and
you'll get the schemas, binding and a helpful orchestration with
port types add to your project
Create a simple map mapping your inbound oracle recordset schema to
your web service schema - this should be pretty straight forward if
they are identical, although I suspect you'll have to deal with
multiple sets of data - depends on your data.
Complete by wiring together your orchestration.
I appreciate this is a high level view of what you need to do, but there are plenty of example you can google to get you started. Hope that helps.
I'm trying to write an automated test for my app's response for a third party service being down.
Generally the service is always up. I'm looking for a reliable way to simulate it being down notably without requiring root access. To put another wrinkle in it: The application under test would be in a separate process. I thought of just altering the configuration pointing at the service but that's not going to work.
This is all happening in a unix environment (linux, os x) so I'd like it to work there, but I don't care about windows. Is there a quick way to block an outgoing port or something like that? It also has to be temporary as this has to happen in the middle of a larger test suite.
Hopefully there is a fairly standard way of doing this that I just haven't found yet.
Clarification: This is a functional test to make sure the gui responds correctly when the service is down. The unit test is already covered.
Make a proxy for the service. Point at the proxy for the service. Shoot down the proxy for the service.
If your application has been designed with unit-testing in mind, you should be able to replace the 3rd party service with a different implementation.
The idea is that you can replace the service with a mock object which returns dummy data for testing. You could also replace the service with an object that throws an exception, or times-out.
With the mock service in place, the tester can use the application and see how it responds to service failures.