lensesio / kafka-topics-ui Goto Github PK

View Code? Open in Web Editor NEW

877.0 44.0 149.0 4.52 MB

Web Tool for Kafka Topics |

Home Page: https://lenses.io

HTML 21.50% JavaScript 68.13% CSS 7.76% Shell 1.84% Dockerfile 0.77%

kafka-topics-ui's People

Contributors

Stargazers

Watchers

Forkers

ganghuawang bbnsumanth imdark hardikdr improvedigital vicchugu hahalml vuchau igorglad sadhiesh cammette qdubious rerlinger amareshp drosi94 apple006 mazjs vsmolik manoranjan1987 theroich msarkar006 parrot-stream exacloud gunbuster135 edric-shen yacut nodefluent panchul aland-zhang gary-bliss jmwilli25 acornsgrow harksin sammolokanov rvojjala alexxnica kryndex lrecknagel ptzagk shadowwalker2718 erikvullings croeck kadnikovvn lihaolixuewei112612 reef007 portxchange bacek pihlajus balabalayi kartius jeperez dbustosp jahstreet charlesakalugwu andrewduckett nilportugues riveryong tgbyte raylua2566 0xqq divyapraveen rtarar maduhu sangrho paternallove driver-eu tommyteavee t1seungy varyumin ttapjinda suixuan ecoeppasa jackljohnson boob-sbcm nbuesing thpham librannk rmsnandha untitled-life houjie1979 slachiewicz andrej1a yum-install-brains yankhonskikendaxa blacktree bfillion gk8143197049 hllanes zjlavender jsalmeron smaity8136 suanmeiguo nickolasbenakis axv0419 tkiyer ahmautom mohbadar amrlotfy77 zawwinminict zhangjianhrm

kafka-topics-ui's Issues

Double horizontal scroll bar when viewing table data for yahoo-stocks

v2 of the UI
browser: chrome latest

Seek to end doesn't work

Hello,

Seek to end

always give me

No data fetched

any idea what cause the problem?

Thank you.

topic-ui cannot fetch topic content

I managed to setup topics-ui to connect with rest proxy and fetch the topic list but the UI does not manage to load the topic's information/content. The detail setting of dockers are as following:

docker-compose.yml for all the services:

  zookeeper:
    image: "confluentinc/cp-zookeeper"
    container_name: zookeeper
    ports:
      - "2181:2181"
    environment:
      - ZOOKEEPER_CLIENT_PORT=2181

  kafka:
    image: "confluentinc/cp-kafka"
    container_name: kafka
    ports:
      - "9092:9092"
    depends_on:
      - zookeeper
    environment:
      - KAFKA_ZOOKEEPER_CONNECT=zookeeper:2181
      - KAFKA_ADVERTISED_LISTENERS=PLAINTEXT://kafka:9092

  schema-registry:
    image: "confluentinc/cp-schema-registry"
    container_name: schema-registry
    ports:
      - "8081:8081"
    depends_on:
      - zookeeper
      - kafka
    environment:
      - SCHEMA_REGISTRY_KAFKASTORE_CONNECTION_URL=zookeeper:2181
      - SCHEMA_REGISTRY_HOST_NAME=schema-registry
      - SCHEMA_REGISTRY_LISTENERS=http://schema-registry:8081

  kafka-rest:
    image: "confluentinc/cp-kafka-rest"
    container_name: kafka-rest
    ports:
      - "8082:8082"
    environment:
     - ACCESS_CONTROL_ALLOW_ORIGIN_DEFAULT="*"
     - KAFKA_REST_SCHEMA_REGISTRY_URL=http://schema-registry:8081
     - KAFKA_REST_ZOOKEEPER_CONNECT=zookeeper:2181
     - KAFKA_REST_LISTENERS=http://kafka-rest:8082
     - KAFKA_REST_HOST_NAME=kafka-rest
    depends_on:
      - kafka
      - schema-registry
      - zookeeper

  kafka-topic-ui:
    image: "landoop/kafka-topics-ui"
    container_name: kafka-topics-ui
    ports:
      - "8000:8000"
    environment:
      - KAFKA_REST_PROXY_URL=http://kafka-rest:8082
      - SCHEMAREGISTRY_UI_URL=http://schema-registry:8081
      - PROXY=true
    depends_on:
      - kafka
      - schema-registry
      - zookeeper
      - kafka-rest

I can see the topics' name on the UI. But when I click on a topic, its details is never loaded:

I have tried different options with settings of kafka-rest and schema-registry following This issue and this doc and finally come to this settings. However, it does not seem to work in my case.

Can you advice me on fixing this issue?
Thanks,
/Nhan

System vs non-system topics

Not sure if there's a more technical meaning, but I see:

non-system: _schemas, connect-status-01
system: connect-configs-01, connect-offsets-01 (and __consumer_offsets, which is clearly system)

I think all connect should stay together, and possibly _schemas could go into system?

Kafka Topics UI timing out on topic content load

Hi Guys,
I downloaded your code and tried running it on confluent's Kafka Rest API. As you have suggested I configured ngnix to get around the CORS related issues.

However when I load the UI I get a 404 on the console because UI is trying to load
"/topics/_schemas/partitions" which does not exist on the API.

Afterwards it is trying to load '/consumers/kafka_topics_ui_avro_2017-06-02-04-51-38-483/instances/kafka-topics-ui-avro/records?timeout=500&max_bytes=50000' which does not exist again and it times out.

On the UI I do not see any topics being loaded.

Any help would be greatly appreciated.

Incorrect parsing of message key produces bad table display

Description

kafka-topics-ui seems to parse plain string message keys incorrectly when displaying messages in a table, interpreting the length of the key string as the number of fields in the key. This results in offset table rows for messages, with values that no longer line up to the table headers.

Steps to reproduce the issue:

Produce messages to a Kafka topic whose key are plain strings.
View the topic in kafka-topics-ui in the table view.

Describe the results you received:

Assuming the key is a 5 character string, the table view generates 5 columns under key, but outputs a single table element consisting of the 5 character key. This results in the message value being pulled into the key columns by 4 (see picture).

Describe the results you expected:

For the above screenshot, there should be a single column for the key. The remaining row cells (UCP01, 1000, 00001, etc.) should line up under BUSINESS_UNIT, PROJECT_ID, ACTIVITY_ID, etc. Something like this constructed screenshot.

Additional information you deem important (e.g. issue happens only occasionally):

Using landoop/kafka-topics-ui:0.8.1.

Here's a screenshot of the topic view, showing the correct data.

Please minify and pack javascript code in docker image

Loading from separating assets is really slow, please minify and pack the javascript and css when build docker images.

Docker ignores schema registry url

schema registry url parameter gets ignored, when starting the docker container

docker run --rm -it -p 8000:8000 -e "SCHEMAREGISTRY_UI_URL=localhost:8081" -e "KAFKA_REST_PROXY_URL=localhost:8082" landoop/kafka-topics-ui

How to specify Schema Registry URL?

How do I specify the Schema Registry URL when running as a Docker container? The only mention of the Schema Registry seems to be the README saying that it's optional.

Use urlSchema instead of SCHEMA_REGISTRY_UI

In src/env.conf a location is duplicated

Add support for additional headers in backend REST

When Kafka REST is installed in a header protected end-point, a set of additional Headers might need to be delivered on every API request:

-H "X-Auth-Token: APIKEY"

For example on BlueMix: https://console.bluemix.net/docs/services/MessageHub/messagehub025.html#rest_using

env.js should provide mechanisms for additional headers

Not able to fetch topic data on UI.Getting error coe: 422 ,Message: "Invalid format type", with following message: "We don't really know the data type of topicABC so we will attempt all options.."

Unable to load data within topics

Hello guys,

I have currently the following issue. We are using topics-viewer 0.9.2 but we cannot see the data within the topics anymore. The Chrome developer console lists following error:

If I downgrade to 0.8.3 the data within the topics are shown in Chrome but not the topics anymore. In Microsoft Edge everything is fine for 0.8.3 (topics and data are shown).

Chrome version: 61.0.3163.100
Edge version: 40.15063.0.0

Kafka-Rest-Properties:

Thanks for your help,
Stephan

Chinese characters cannot be displayed properly

Hi,
we have used this tool for a while, really helps a lot. But somehow, the Chinese characters can't be displayed properly, which shown as followed:
{"des":"å�ºé�¨é�®é�®æ�ºè�½æ�¨é��","title":"G1895 15:37å��è½¦","ticker":["14è½¦10Cå�·ã��10Då�·"]}
Is there any configuration I can do to fix this problem?

Thanks
BR

Avro or Json deserialization can wrongly be considered as failed

Hi,

If the Avro message contains "error" (or if the Json message contains "error_code"),
the deserialization will be considered as failed even if it has succeeded.

It seems that the code responsible of that issue is this error handling:

    var dataPromiseAvro = KafkaRestProxyFactory.consumeKafkaRest("avro", $scope.topicName);
    dataPromiseAvro.then(function (allData) {
      if (JSON.stringify(allData).indexOf("error") > 0) {
        $log.warn('Failed with Avro - going to try with Json this time (' + allData + ')');
        var dataPromiseAvro = KafkaRestProxyFactory.consumeKafkaRest("json", $scope.topicName);
        dataPromiseAvro.then(
          function (allData) {
            if (JSON.stringify(allData).indexOf("error_code") > 0) {
              $log.warn('Failed with JSon as well - going to try with Binary this time (' + allData + ')');

https://github.com/Landoop/kafka-topics-ui/blob/179c8c445455ab4924e595a4eaf6d4215f010e9a/src/kafka-topics/view/view.controller.js#L343

Topics with names that start with numbers crash drPagination

Topics with names that start with numbers crash drPagination since we use the word topics as paganation-id, We should change that to be some constant string everywhere we use drPaganation
see:
michaelbromley/angularUtils#400

topic list and message in topics should auto-refreash and not just stay static

As a view to kafka topics that does not refresh the ui uses are limited, in ops.
Also this will fix #11

Kafka Topics UI with uppercase character

If my topic is called my.Topic for example, and it's an avro topic, the schema registry ui will show the uppercase fine, and will show the schema fine as well, but the topics UI will try to retrieve the schema in the lowercase form and display the topic in the lowercase form, therefore displaying an "topic empty" error

Kafka-topic-ui doesn't start when project started from 'build from source'

In any projects: Kafka-topic-ui, kafka-connect-ui, schema-registry-ui
when I choose to start application from "Build from source" I'm getting these errors (404):
In browser I can see only blank page.

http-server .
Starting up http-server, serving .
Available on:
http://127.0.0.1:8080
http://192.168.1.75:8080
Hit CTRL-C to stop the server
[Fri Apr 28 2017 13:18:02 GMT-0700 (PDT)] "GET /" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:53.0) Gecko/20100101 Firefox/53.0"
[Fri Apr 28 2017 13:18:02 GMT-0700 (PDT)] "GET /bower_components/bootstrap/dist/css/bootstrap.min.css" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:53.0) Gecko/20100101 Firefox/53.0"
[Fri Apr 28 2017 13:18:02 GMT-0700 (PDT)] "GET /bower_components/bootstrap/dist/css/bootstrap.min.css" Error (404): "Not found"
[Fri Apr 28 2017 13:18:02 GMT-0700 (PDT)] "GET /bower_components/angular-material/angular-material.min.css" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:53.0) Gecko/20100101 Firefox/53.0"
[Fri Apr 28 2017 13:18:02 GMT-0700 (PDT)] "GET /bower_components/angular-material-data-table/dist/md-data-table.min.css" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:53.0) Gecko/20100101 Firefox/53.0"
[Fri Apr 28 2017 13:18:02 GMT-0700 (PDT)] "GET /bower_components/font-awesome/css/font-awesome.min.css" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:53.0) Gecko/20100101 Firefox/53.0"
[Fri Apr 28 2017 13:18:02 GMT-0700 (PDT)] "GET /bower_components/angular-ui-grid/ui-grid.min.css" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:53.0) Gecko/20100101 Firefox/53.0"
[Fri Apr 28 2017 13:18:02 GMT-0700 (PDT)] "GET /bower_components/angular-json-tree/dist/angular-json-tree.css" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:53.0) Gecko/20100101 Firefox/53.0"
[Fri Apr 28 2017 13:18:02 GMT-0700 (PDT)] "GET /bower_components/angular-material/angular-material.min.css" Error (404): "Not found"
[Fri Apr 28 2017 13:18:02 GMT-0700 (PDT)] "GET /bower_components/angular-material-data-table/dist/md-data-table.min.css" Error (404): "Not found"
[Fri Apr 28 2017 13:18:02 GMT-0700 (PDT)] "GET /bower_components/font-awesome/css/font-awesome.min.css" Error (404): "Not found"
[Fri Apr 28 2017 13:18:02 GMT-0700 (PDT)] "GET /bower_components/angular-ui-grid/ui-grid.min.css" Error (404): "Not found"
[Fri Apr 28 2017 13:18:02 GMT-0700 (PDT)] "GET /bower_components/angular-json-tree/dist/angular-json-tree.css" Error (404): "Not found"
[Fri Apr 28 2017 13:18:02 GMT-0700 (PDT)] "GET /bower_components/handsontable/dist/handsontable.full.css" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:53.0) Gecko/20100101 Firefox/53.0"
[Fri Apr 28 2017 13:18:02 GMT-0700 (PDT)] "GET /src/assets/css/styles.css" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:53.0) Gecko/20100101 Firefox/53.0"
[Fri Apr 28 2017 13:18:02 GMT-0700 (PDT)] "GET /bower_components/handsontable/dist/handsontable.full.css" Error (404): "Not found"
[Fri Apr 28 2017 13:18:02 GMT-0700 (PDT)] "GET /bower_components/ace-builds/src-min-noconflict/ace.js" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:53.0) Gecko/20100101 Firefox/53.0"
[Fri Apr 28 2017 13:18:02 GMT-0700 (PDT)] "GET /bower_components/angular/angular.min.js" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:53.0) Gecko/20100101 Firefox/53.0"
[Fri Apr 28 2017 13:18:02 GMT-0700 (PDT)] "GET /bower_components/angular-ui-ace/ui-ace.min.js" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:53.0) Gecko/20100101 Firefox/53.0"
[Fri Apr 28 2017 13:18:02 GMT-0700 (PDT)] "GET /bower_components/spin.js/spin.min.js" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:53.0) Gecko/20100101 Firefox/53.0"
[Fri Apr 28 2017 13:18:02 GMT-0700 (PDT)] "GET /bower_components/angular-spinner/angular-spinner.min.js" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:53.0) Gecko/20100101 Firefox/53.0"
[Fri Apr 28 2017 13:18:02 GMT-0700 (PDT)] "GET /bower_components/ace-builds/src-min-noconflict/ace.js" Error (404): "Not found"
[Fri Apr 28 2017 13:18:02 GMT-0700 (PDT)] "GET /bower_components/angular/angular.min.js" Error (404): "Not found"
[Fri Apr 28 2017 13:18:02 GMT-0700 (PDT)] "GET /bower_components/angular-ui-ace/ui-ace.min.js" Error (404): "Not found"
[Fri Apr 28 2017 13:18:02 GMT-0700 (PDT)] "GET /bower_components/spin.js/spin.min.js" Error (404): "Not found"
[Fri Apr 28 2017 13:18:02 GMT-0700 (PDT)] "GET /bower_components/angular-spinner/angular-spinner.min.js" Error (404): "Not found"
[Fri Apr 28 2017 13:18:02 GMT-0700 (PDT)] "GET /bower_components/angular-route/angular-route.min.js" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:53.0) Gecko/20100101 Firefox/53.0"
[Fri Apr 28 2017 13:18:02 GMT-0700 (PDT)] "GET /bower_components/angular-material/angular-material.min.js" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:53.0) Gecko/20100101 Firefox/53.0"
[Fri Apr 28 2017 13:18:02 GMT-0700 (PDT)] "GET /bower_components/angular-animate/angular-animate.min.js" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:53.0) Gecko/20100101 Firefox/53.0"
[Fri Apr 28 2017 13:18:02 GMT-0700 (PDT)] "GET /bower_components/angular-aria/angular-aria.min.js" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:53.0) Gecko/20100101 Firefox/53.0"
[Fri Apr 28 2017 13:18:02 GMT-0700 (PDT)] "GET /bower_components/angular-material-data-table/dist/md-data-table.min.js" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:53.0) Gecko/20100101 Firefox/53.0"
[Fri Apr 28 2017 13:18:02 GMT-0700 (PDT)] "GET /bower_components/angular-route/angular-route.min.js" Error (404): "Not found"
[Fri Apr 28 2017 13:18:02 GMT-0700 (PDT)] "GET /bower_components/angular-ui-grid/ui-grid.min.js" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:53.0) Gecko/20100101 Firefox/53.0"
[Fri Apr 28 2017 13:18:02 GMT-0700 (PDT)] "GET /bower_components/angular-material/angular-material.min.js" Error (404): "Not found"
[Fri Apr 28 2017 13:18:02 GMT-0700 (PDT)] "GET /bower_components/angular-animate/angular-animate.min.js" Error (404): "Not found"
[Fri Apr 28 2017 13:18:02 GMT-0700 (PDT)] "GET /bower_components/angular-aria/angular-aria.min.js" Error (404): "Not found"
[Fri Apr 28 2017 13:18:02 GMT-0700 (PDT)] "GET /bower_components/angular-material-data-table/dist/md-data-table.min.js" Error (404): "Not found"
[Fri Apr 28 2017 13:18:02 GMT-0700 (PDT)] "GET /bower_components/angular-ui-grid/ui-grid.min.js" Error (404): "Not found"
[Fri Apr 28 2017 13:18:02 GMT-0700 (PDT)] "GET /bower_components/angular-base64/angular-base64.min.js" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:53.0) Gecko/20100101 Firefox/53.0"
[Fri Apr 28 2017 13:18:02 GMT-0700 (PDT)] "GET /bower_components/oboe/dist/oboe-browser.min.js" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:53.0) Gecko/20100101 Firefox/53.0"
[Fri Apr 28 2017 13:18:02 GMT-0700 (PDT)] "GET /bower_components/angular-oboe/dist/angular-oboe.min.js" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:53.0) Gecko/20100101 Firefox/53.0"
[Fri Apr 28 2017 13:18:02 GMT-0700 (PDT)] "GET /bower_components/angular-json-tree/dist/angular-json-tree.min.js" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:53.0) Gecko/20100101 Firefox/53.0"
[Fri Apr 28 2017 13:18:02 GMT-0700 (PDT)] "GET /bower_components/handsontable/dist/handsontable.full.js" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:53.0) Gecko/20100101 Firefox/53.0"
[Fri Apr 28 2017 13:18:02 GMT-0700 (PDT)] "GET /bower_components/ngHandsontable/dist/ngHandsontable.js" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:53.0) Gecko/20100101 Firefox/53.0"
[Fri Apr 28 2017 13:18:02 GMT-0700 (PDT)] "GET /bower_components/angular-base64/angular-base64.min.js" Error (404): "Not found"
[Fri Apr 28 2017 13:18:02 GMT-0700 (PDT)] "GET /bower_components/oboe/dist/oboe-browser.min.js" Error (404): "Not found"
[Fri Apr 28 2017 13:18:02 GMT-0700 (PDT)] "GET /bower_components/angular-oboe/dist/angular-oboe.min.js" Error (404): "Not found"
[Fri Apr 28 2017 13:18:02 GMT-0700 (PDT)] "GET /bower_components/angular-json-tree/dist/angular-json-tree.min.js" Error (404): "Not found"
[Fri Apr 28 2017 13:18:02 GMT-0700 (PDT)] "GET /bower_components/handsontable/dist/handsontable.full.js" Error (404): "Not found"
[Fri Apr 28 2017 13:18:02 GMT-0700 (PDT)] "GET /bower_components/ngHandsontable/dist/ngHandsontable.js" Error (404): "Not found"
[Fri Apr 28 2017 13:18:02 GMT-0700 (PDT)] "GET /env.js" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:53.0) Gecko/20100101 Firefox/53.0"
[Fri Apr 28 2017 13:18:02 GMT-0700 (PDT)] "GET /src/app.js" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:53.0) Gecko/20100101 Firefox/53.0"
[Fri Apr 28 2017 13:18:02 GMT-0700 (PDT)] "GET /src/kafka.defaults.js" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:53.0) Gecko/20100101 Firefox/53.0"
[Fri Apr 28 2017 13:18:02 GMT-0700 (PDT)] "GET /src/topics.config.js" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:53.0) Gecko/20100101 Firefox/53.0"
[Fri Apr 28 2017 13:18:02 GMT-0700 (PDT)] "GET /src/factories/dirPagination.js" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:53.0) Gecko/20100101 Firefox/53.0"
[Fri Apr 28 2017 13:18:02 GMT-0700 (PDT)] "GET /src/kafka-topics/home/home.controller.js" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:53.0) Gecko/20100101 Firefox/53.0"
[Fri Apr 28 2017 13:18:02 GMT-0700 (PDT)] "GET /src/kafka-topics/view/view.controller.js" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:53.0) Gecko/20100101 Firefox/53.0"
[Fri Apr 28 2017 13:18:02 GMT-0700 (PDT)] "GET /src/kafka-topics/config/config.controller.js" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:53.0) Gecko/20100101 Firefox/53.0"
[Fri Apr 28 2017 13:18:02 GMT-0700 (PDT)] "GET /src/kafka-topics/list/topics-list.controller.js" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:53.0) Gecko/20100101 Firefox/53.0"
[Fri Apr 28 2017 13:18:02 GMT-0700 (PDT)] "GET /src/factories/kafka-rest-proxy-factory.js" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:53.0) Gecko/20100101 Firefox/53.0"
[Fri Apr 28 2017 13:18:02 GMT-0700 (PDT)] "GET /src/factories/env.factory.js" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:53.0) Gecko/20100101 Firefox/53.0"
[Fri Apr 28 2017 13:18:02 GMT-0700 (PDT)] "GET /src/factories/utils-factory.js" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:53.0) Gecko/20100101 Firefox/53.0"
[Fri Apr 28 2017 13:18:02 GMT-0700 (PDT)] "GET /src/factories/toast-factory.js" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:53.0) Gecko/20100101 Firefox/53.0"
[Fri Apr 28 2017 13:18:02 GMT-0700 (PDT)] "GET /bower_components/angular/angular.min.js" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:53.0) Gecko/20100101 Firefox/53.0"
[Fri Apr 28 2017 13:18:02 GMT-0700 (PDT)] "GET /bower_components/angular/angular.min.js" Error (404): "Not found"
[Fri Apr 28 2017 13:18:03 GMT-0700 (PDT)] "GET /bower_components/angular-ui-ace/ui-ace.min.js" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:53.0) Gecko/20100101 Firefox/53.0"
[Fri Apr 28 2017 13:18:03 GMT-0700 (PDT)] "GET /bower_components/angular-ui-ace/ui-ace.min.js" Error (404): "Not found"
[Fri Apr 28 2017 13:18:03 GMT-0700 (PDT)] "GET /bower_components/spin.js/spin.min.js" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:53.0) Gecko/20100101 Firefox/53.0"
[Fri Apr 28 2017 13:18:03 GMT-0700 (PDT)] "GET /bower_components/spin.js/spin.min.js" Error (404): "Not found"
[Fri Apr 28 2017 13:18:03 GMT-0700 (PDT)] "GET /bower_components/angular-spinner/angular-spinner.min.js" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:53.0) Gecko/20100101 Firefox/53.0"
[Fri Apr 28 2017 13:18:03 GMT-0700 (PDT)] "GET /bower_components/angular-spinner/angular-spinner.min.js" Error (404): "Not found"
[Fri Apr 28 2017 13:18:03 GMT-0700 (PDT)] "GET /bower_components/angular-route/angular-route.min.js" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:53.0) Gecko/20100101 Firefox/53.0"
[Fri Apr 28 2017 13:18:03 GMT-0700 (PDT)] "GET /bower_components/angular-route/angular-route.min.js" Error (404): "Not found"
[Fri Apr 28 2017 13:18:03 GMT-0700 (PDT)] "GET /bower_components/angular-material/angular-material.min.js" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:53.0) Gecko/20100101 Firefox/53.0"
[Fri Apr 28 2017 13:18:03 GMT-0700 (PDT)] "GET /bower_components/angular-material/angular-material.min.js" Error (404): "Not found"
[Fri Apr 28 2017 13:18:03 GMT-0700 (PDT)] "GET /bower_components/angular-animate/angular-animate.min.js" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:53.0) Gecko/20100101 Firefox/53.0"
[Fri Apr 28 2017 13:18:03 GMT-0700 (PDT)] "GET /bower_components/angular-animate/angular-animate.min.js" Error (404): "Not found"
[Fri Apr 28 2017 13:18:03 GMT-0700 (PDT)] "GET /bower_components/angular-aria/angular-aria.min.js" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:53.0) Gecko/20100101 Firefox/53.0"
[Fri Apr 28 2017 13:18:03 GMT-0700 (PDT)] "GET /bower_components/angular-aria/angular-aria.min.js" Error (404): "Not found"
[Fri Apr 28 2017 13:18:03 GMT-0700 (PDT)] "GET /bower_components/angular-material-data-table/dist/md-data-table.min.js" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:53.0) Gecko/20100101 Firefox/53.0"
[Fri Apr 28 2017 13:18:03 GMT-0700 (PDT)] "GET /bower_components/angular-material-data-table/dist/md-data-table.min.js" Error (404): "Not found"
[Fri Apr 28 2017 13:18:03 GMT-0700 (PDT)] "GET /bower_components/angular-ui-grid/ui-grid.min.js" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:53.0) Gecko/20100101 Firefox/53.0"
[Fri Apr 28 2017 13:18:03 GMT-0700 (PDT)] "GET /bower_components/angular-ui-grid/ui-grid.min.js" Error (404): "Not found"
[Fri Apr 28 2017 13:18:03 GMT-0700 (PDT)] "GET /bower_components/angular-base64/angular-base64.min.js" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:53.0) Gecko/20100101 Firefox/53.0"
[Fri Apr 28 2017 13:18:03 GMT-0700 (PDT)] "GET /bower_components/angular-base64/angular-base64.min.js" Error (404): "Not found"
[Fri Apr 28 2017 13:18:03 GMT-0700 (PDT)] "GET /bower_components/oboe/dist/oboe-browser.min.js" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:53.0) Gecko/20100101 Firefox/53.0"
[Fri Apr 28 2017 13:18:03 GMT-0700 (PDT)] "GET /bower_components/oboe/dist/oboe-browser.min.js" Error (404): "Not found"
[Fri Apr 28 2017 13:18:03 GMT-0700 (PDT)] "GET /bower_components/angular-oboe/dist/angular-oboe.min.js" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:53.0) Gecko/20100101 Firefox/53.0"
[Fri Apr 28 2017 13:18:03 GMT-0700 (PDT)] "GET /bower_components/angular-oboe/dist/angular-oboe.min.js" Error (404): "Not found"
[Fri Apr 28 2017 13:18:03 GMT-0700 (PDT)] "GET /bower_components/angular-json-tree/dist/angular-json-tree.min.js" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:53.0) Gecko/20100101 Firefox/53.0"
[Fri Apr 28 2017 13:18:03 GMT-0700 (PDT)] "GET /bower_components/angular-json-tree/dist/angular-json-tree.min.js" Error (404): "Not found"
[Fri Apr 28 2017 13:18:03 GMT-0700 (PDT)] "GET /bower_components/handsontable/dist/handsontable.full.js" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:53.0) Gecko/20100101 Firefox/53.0"
[Fri Apr 28 2017 13:18:03 GMT-0700 (PDT)] "GET /bower_components/handsontable/dist/handsontable.full.js" Error (404): "Not found"
[Fri Apr 28 2017 13:18:03 GMT-0700 (PDT)] "GET /bower_components/ngHandsontable/dist/ngHandsontable.js" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:53.0) Gecko/20100101 Firefox/53.0"
[Fri Apr 28 2017 13:18:03 GMT-0700 (PDT)] "GET /bower_components/ngHandsontable/dist/ngHandsontable.js" Error (404): "Not found"
[Fri Apr 28 2017 13:18:06 GMT-0700 (PDT)] "GET /bower_components/bootstrap/dist/css/bootstrap.min.css" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:53.0) Gecko/20100101 Firefox/53.0"
[Fri Apr 28 2017 13:18:06 GMT-0700 (PDT)] "GET /bower_components/angular-material/angular-material.min.css" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:53.0) Gecko/20100101 Firefox/53.0"
[Fri Apr 28 2017 13:18:06 GMT-0700 (PDT)] "GET /bower_components/angular-material-data-table/dist/md-data-table.min.css" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:53.0) Gecko/20100101 Firefox/53.0"
[Fri Apr 28 2017 13:18:06 GMT-0700 (PDT)] "GET /bower_components/bootstrap/dist/css/bootstrap.min.css" Error (404): "Not found"
[Fri Apr 28 2017 13:18:06 GMT-0700 (PDT)] "GET /bower_components/angular-material/angular-material.min.css" Error (404): "Not found"
[Fri Apr 28 2017 13:18:06 GMT-0700 (PDT)] "GET /bower_components/font-awesome/css/font-awesome.min.css" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:53.0) Gecko/20100101 Firefox/53.0"
[Fri Apr 28 2017 13:18:06 GMT-0700 (PDT)] "GET /bower_components/angular-material-data-table/dist/md-data-table.min.css" Error (404): "Not found"
[Fri Apr 28 2017 13:18:06 GMT-0700 (PDT)] "GET /bower_components/angular-ui-grid/ui-grid.min.css" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:53.0) Gecko/20100101 Firefox/53.0"
[Fri Apr 28 2017 13:18:06 GMT-0700 (PDT)] "GET /bower_components/angular-json-tree/dist/angular-json-tree.css" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:53.0) Gecko/20100101 Firefox/53.0"
[Fri Apr 28 2017 13:18:06 GMT-0700 (PDT)] "GET /bower_components/font-awesome/css/font-awesome.min.css" Error (404): "Not found"
[Fri Apr 28 2017 13:18:06 GMT-0700 (PDT)] "GET /bower_components/angular-ui-grid/ui-grid.min.css" Error (404): "Not found"
[Fri Apr 28 2017 13:18:06 GMT-0700 (PDT)] "GET /bower_components/angular-json-tree/dist/angular-json-tree.css" Error (404): "Not found"
[Fri Apr 28 2017 13:18:07 GMT-0700 (PDT)] "GET /bower_components/handsontable/dist/handsontable.full.css" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:53.0) Gecko/20100101 Firefox/53.0"
[Fri Apr 28 2017 13:18:07 GMT-0700 (PDT)] "GET /bower_components/ace-builds/src-min-noconflict/ace.js" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:53.0) Gecko/20100101 Firefox/53.0"
[Fri Apr 28 2017 13:18:07 GMT-0700 (PDT)] "GET /bower_components/angular/angular.min.js" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:53.0) Gecko/20100101 Firefox/53.0"
[Fri Apr 28 2017 13:18:07 GMT-0700 (PDT)] "GET /bower_components/angular-ui-ace/ui-ace.min.js" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:53.0) Gecko/20100101 Firefox/53.0"
[Fri Apr 28 2017 13:18:07 GMT-0700 (PDT)] "GET /bower_components/spin.js/spin.min.js" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:53.0) Gecko/20100101 Firefox/53.0"
[Fri Apr 28 2017 13:18:07 GMT-0700 (PDT)] "GET /bower_components/handsontable/dist/handsontable.full.css" Error (404): "Not found"
[Fri Apr 28 2017 13:18:07 GMT-0700 (PDT)] "GET /bower_components/ace-builds/src-min-noconflict/ace.js" Error (404): "Not found"
[Fri Apr 28 2017 13:18:07 GMT-0700 (PDT)] "GET /bower_components/angular/angular.min.js" Error (404): "Not found"
[Fri Apr 28 2017 13:18:07 GMT-0700 (PDT)] "GET /bower_components/angular-ui-ace/ui-ace.min.js" Error (404): "Not found"
[Fri Apr 28 2017 13:18:07 GMT-0700 (PDT)] "GET /bower_components/spin.js/spin.min.js" Error (404): "Not found"
[Fri Apr 28 2017 13:18:07 GMT-0700 (PDT)] "GET /bower_components/angular-spinner/angular-spinner.min.js" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:53.0) Gecko/20100101 Firefox/53.0"
[Fri Apr 28 2017 13:18:07 GMT-0700 (PDT)] "GET /bower_components/angular-spinner/angular-spinner.min.js" Error (404): "Not found"
[Fri Apr 28 2017 13:18:07 GMT-0700 (PDT)] "GET /bower_components/angular-route/angular-route.min.js" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:53.0) Gecko/20100101 Firefox/53.0"
[Fri Apr 28 2017 13:18:07 GMT-0700 (PDT)] "GET /bower_components/angular-material/angular-material.min.js" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:53.0) Gecko/20100101 Firefox/53.0"
[Fri Apr 28 2017 13:18:07 GMT-0700 (PDT)] "GET /bower_components/angular-animate/angular-animate.min.js" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:53.0) Gecko/20100101 Firefox/53.0"
[Fri Apr 28 2017 13:18:07 GMT-0700 (PDT)] "GET /bower_components/angular-aria/angular-aria.min.js" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:53.0) Gecko/20100101 Firefox/53.0"
[Fri Apr 28 2017 13:18:07 GMT-0700 (PDT)] "GET /bower_components/angular-material-data-table/dist/md-data-table.min.js" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:53.0) Gecko/20100101 Firefox/53.0"
[Fri Apr 28 2017 13:18:07 GMT-0700 (PDT)] "GET /bower_components/angular-route/angular-route.min.js" Error (404): "Not found"
[Fri Apr 28 2017 13:18:07 GMT-0700 (PDT)] "GET /bower_components/angular-material/angular-material.min.js" Error (404): "Not found"
[Fri Apr 28 2017 13:18:07 GMT-0700 (PDT)] "GET /bower_components/angular-animate/angular-animate.min.js" Error (404): "Not found"
[Fri Apr 28 2017 13:18:07 GMT-0700 (PDT)] "GET /bower_components/angular-aria/angular-aria.min.js" Error (404): "Not found"
[Fri Apr 28 2017 13:18:07 GMT-0700 (PDT)] "GET /bower_components/angular-material-data-table/dist/md-data-table.min.js" Error (404): "Not found"
[Fri Apr 28 2017 13:18:07 GMT-0700 (PDT)] "GET /bower_components/angular-ui-grid/ui-grid.min.js" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:53.0) Gecko/20100101 Firefox/53.0"
[Fri Apr 28 2017 13:18:07 GMT-0700 (PDT)] "GET /bower_components/angular-ui-grid/ui-grid.min.js" Error (404): "Not found"
[Fri Apr 28 2017 13:18:07 GMT-0700 (PDT)] "GET /bower_components/angular-base64/angular-base64.min.js" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:53.0) Gecko/20100101 Firefox/53.0"
[Fri Apr 28 2017 13:18:07 GMT-0700 (PDT)] "GET /bower_components/oboe/dist/oboe-browser.min.js" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:53.0) Gecko/20100101 Firefox/53.0"
[Fri Apr 28 2017 13:18:07 GMT-0700 (PDT)] "GET /bower_components/angular-oboe/dist/angular-oboe.min.js" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:53.0) Gecko/20100101 Firefox/53.0"
[Fri Apr 28 2017 13:18:07 GMT-0700 (PDT)] "GET /bower_components/angular-json-tree/dist/angular-json-tree.min.js" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:53.0) Gecko/20100101 Firefox/53.0"
[Fri Apr 28 2017 13:18:07 GMT-0700 (PDT)] "GET /bower_components/handsontable/dist/handsontable.full.js" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:53.0) Gecko/20100101 Firefox/53.0"
[Fri Apr 28 2017 13:18:07 GMT-0700 (PDT)] "GET /bower_components/angular-base64/angular-base64.min.js" Error (404): "Not found"
[Fri Apr 28 2017 13:18:07 GMT-0700 (PDT)] "GET /bower_components/oboe/dist/oboe-browser.min.js" Error (404): "Not found"
[Fri Apr 28 2017 13:18:07 GMT-0700 (PDT)] "GET /bower_components/angular-oboe/dist/angular-oboe.min.js" Error (404): "Not found"
[Fri Apr 28 2017 13:18:07 GMT-0700 (PDT)] "GET /bower_components/angular-json-tree/dist/angular-json-tree.min.js" Error (404): "Not found"
[Fri Apr 28 2017 13:18:07 GMT-0700 (PDT)] "GET /bower_components/handsontable/dist/handsontable.full.js" Error (404): "Not found"
[Fri Apr 28 2017 13:18:07 GMT-0700 (PDT)] "GET /bower_components/ngHandsontable/dist/ngHandsontable.js" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:53.0) Gecko/20100101 Firefox/53.0"
[Fri Apr 28 2017 13:18:07 GMT-0700 (PDT)] "GET /bower_components/ngHandsontable/dist/ngHandsontable.js" Error (404): "Not found"

Topics list lost in special ocasion

Version 0.9.1
Browser: chrome 55
Steps. Click on the settings icon on the top right corner after you browsed a topic. Then go back on the browser. It loses the topics list

Error when start kafka-topics-ui container: Interrupted system call

I had non-deterministic result when starting the kafka-topics-ui container. From the log it says:

Enabling proxy.
/run.sh: line 20: can't create /caddy/Caddyfile: Interrupted system call
Kafka REST Proxy URL to /api/kafka-rest-proxy.

Restarts the container may solve the problem but was wondering if there's a better way to do.

Context:

Docker-compose file: https://github.com/akking/community-catalog/blob/master/templates/kafka/0/docker-compose.yml
Running on Rancher.

Have a basic docker-compose file that includes kafka-rest to use against an existing Kafka cluster

I'm trying to get kafka-topics-ui running on my laptop for quick dev/debug purposes against an existing Kafka cluster that doesn't have kafka-rest.

It'd be nice if there was a simple docker-compose file that stood up both the kafka-topics-ui and the kafka-rest client, handled connecting them, and just needed to be passed a zookeeper address plus a desired kafka-topics-ui http endpiont, and (optionally) a kafka schema registry url. No need for anything more as robustness/latency doesn't matter in this type of situation.

While I can (and am) going through the hassle of setting this up myself, I suspect this is a very common usecase, so you'd increase adoption by making it super easy to get going.

timeout setting should be configurable within docker

Hey guys,

I recently switch over the latest version : 0.9.2 that use v2 API of kafka-rest.

It seems like v2 api (with the new consumer thingy) is really slow for the first fetch of any consumer when dealing with pretty large topics.

I had "Empty Topic" shown over kafka-topic-ui for any large topic because it was hitting the timeout.

I changed the timeout on Kafka-rest but I also need to change the timeout specified by the ui when calling kafka-rest (/records).

Thanks !

Old consumer remain if the consumer failed to retrieve data

I have a lot of old consumers in zookeeper.
When an error throw at consumer time it seems that the consumer instance is not deleted.
The consumer name is timestamped so it is not reusable.
It is usefull to keep it?

docker image env SCHEMAREGISTRY_UI_URL has no effect

Configured SCHEMAREGISTRY_UI_URL env variable, but in the UI it still refers to http://schema-registry-ui.landoop.com.

Add support to auto discover topic format

if a topic is not an avro format, we should try to parse it as json and otherwise show as binary.

UI fails to parse specific topic names

Hi,
I've got "parse syntax" errors in console if there is at least one topic has name starting with numeric symbols (for example "123topic").
Kafka topic name regex is "[a-zA-Z0-9._-]", so "123topic" name is quite legal.

Not compatible with Chrome and Internet Explorer

The newest version doesn't work properly with Chrome and Internet Explorer. Only Microsoft Edge show the whole website properly. For example at Chrome occurs connection error which doesn't appear at Edge.

Add nginx to docker image

It would be great it docker image had nginx setup adding required CORS headers. Right now it just does not work if kafka runs somewhere else.

New release 0.8.2?

Hello,
do you know when could you make a new release?
There is a lots of bugs fixes that i'm interested in.
Thanks

current version (0.7) throws KafkaRestProxyFactory.isControlTopic is not a function for non predefined topics

this happens on topics without predefined types such as:
https://kafka-topics-ui.landoop.com/#/topic/kafka-connect-logs
isControlTopic is not exposed on KafkaRestProxyFactory

Create Chrome extension

Feature Request: Optionally display more than 10 items in topic and table views

Description

When viewing a topic, the TOPIC and TABLE views display 10 items per page. For a topic with a large number of messages on a large display, this results in a suboptimal display of items due to the need to paginate extensively and unused screen real estate.

It would be useful to have an option to show more than 10 items per page to make it easier to scan through large topics and use available screen real estate.

Steps to reproduce the issue:

Have a topic with a large number of messages. In my example, I am browsing topics with over 100 messages.
In kafka-topics-ui, select the topic and look at the TOPIC and TABLE views.

Describe the results you received:

Both the TOPIC and TABLE views are limited to 10 items per page.

Describe the results you expected:

I would like the views to display a user selectable number of items per page. There should also be a way to set a default number of items per page.

Additional information you deem important (e.g. issue happens only occasionally):

The observations are based on the landoop/kafka-topics-ui:0.8.2 Docker image.

Make v2 API calls by default with REST Proxy 3.2.0

The REST Proxy has been updated to leverage the new consumer http://docs.confluent.io/3.2.0/kafka-rest/docs/intro.html#produce-and-consume-avro-messages

We need to have Kafka topics UI switch its API calls to v2 with a config (?)

vote for this to work via direct contact to brokers

The readme says there are plans to have this work not only through the rest proxy. Would be nice if we could just connect via a list of brokers:ports.

topic-ui cannot fetch topic content

duplicated of #72

kafka 0.10.2.0 version CONNECTIVITY ERROR

can upgrade to 0.10.2.0?

CORS error with Confluent 3.2.0

Is this compatible with Confluent 3.2.0 as I keep getting a CORS error for some reason. I have defined the 'allows.control.access.origin=*' key in kafka-rest, and the 8.2 version of the UI was working for me with the same exact settings on Confluent 3.1.2.

Also, I am able to send the same requests via Postman successfully.

i found message has some different, some only have RAW DATA, but some have TABLE

just like this，Is that the way I push messages?

i know this should not be a issues, i just really can't understand this , so i hope you can help me .....

Create DC/OS universe component

https://github.com/mesosphere/universe/

Topics list pagination arrows get cut off with large number of pages

Description

The pagination arrows for the topics list gets cuts off on the sides when there are a large number of topics and the page numbers are long (wide).

Steps to reproduce the issue:

Use kafka-topics-ui to connect to a Kafka cluster with a large number of topics.

Describe the results you received:

In my case, there are 96 topics resulting in 14 pages in the topics list. The higher page numbers (10 to 14) take more horizontal space, pushing the left and right arrows off the side the topics list.

Describe the results you expected:

kafka-topics-ui should fit the page numbers and arrows as necessary.

Additional information you deem important (e.g. issue happens only occasionally):

Using the landoop/kafka-topics-ui:0.8.2 Docker image.

Consumer Message Limits

Hi,

I currently have a topic that has 180 messages in it. I notice that it consistently fetches 38 messages for this specific topic. I am able to see the remainder topics by setting the specific offset, but that doesn't seem very intuitive.

I have used both the REST proxy and the kafka-console-consumer to verify that the topic does indeed contain all the messages, so I am at a loss as to why this would happen.

I assume the REST proxy might be sending down a limited number of messages?

To make things even more confusing, I have another topic that has over 5000 messages and the topics-ui seems to only fetch 36 rows, and setting the offset doesn't allow me to jump to the proper records.

I am using the fast-data-dev docker image and a jdbc source connector to load the data.

Docker Hub image for 0.8.3/latest failed to build

The latest tag failed to build on Docker Hub for the 0.8.3 update.

https://hub.docker.com/r/landoop/kafka-topics-ui/builds/bwbrgffynfdpx2plbeqgggm/

Make it possible to use without schema registry

We use Kafka without a schema registry, just use JSON for everything.

Can I use this UI without a schema registry? The docs for running with docker seem to imply no.

Sometimes on new consumer groups, first consumers don't show any messages

if a a consumer group by a name is created for the first time, it might take rest-proxy take a few milliseconds to pull its messages, since kafka-topics-ui immediately kills new consumers, it might never get a chance to access the messages on the topic.

To repro,

create a new topic in kafka
2.publish json or binary messages to the new topic (avro-schema adds a timeout that stop you from reproducing)
3.only access it by kafka-topics-ui, the messages will probably not appear in ui and will never be pulled since rest proxy will not get a chance to populate the consumer.

topic ui cannot list the toppics

toppic ui can see how many toppics ,but it didn't list them , so i can't fetch the topic content.
and i check the request in topic ui /api/kafka-rest-proxy/topics , it response "["_schemas","logs-platform_json","logs-platform_text","logs-tenant_json","logs-tenant_text","muti-partion","text-log-v1"]".
this is my topic ,i think my rest maybe correct .

and my topic ui version is 0.8.3 ,i use this docker image: landoop/kafka-topics-ui:0.8.3.
because i met the same problem justlike #72 , could you help me ?

getting kafka-topics-ui running against a kafka set-up alternative to the bundled confluent one

@andmarios
You were able to help me last week over here on the fast-data-dev by allowing me to add ADV_HOST to the kafka ... I was just wondering if you might be able to point me in the right direction here.

I was running through this debezium tutorial, which ends with various running containers.

CONTAINER ID        IMAGE                                   COMMAND                  CREATED             STATUS              PORTS                                                                    NAMES
90ca0b0f7284        debezium/connect:0.3                    "/docker-entrypoint.s"   2 hours ago         Up 2 hours          0.0.0.0:8083->8083/tcp, 9092/tcp                                         connect
3308ef37f780        debezium/kafka:0.3                      "/docker-entrypoint.s"   2 hours ago         Up 2 hours          9092/tcp                                                                 watcher
40feb981ad0d        mysql:5.7                               "docker-entrypoint.sh"   3 hours ago         Up 3 hours          3306/tcp                                                                 mysqlterm
bc4bddc80856        debezium/example-mysql:0.3              "docker-entrypoint.sh"   3 hours ago         Up 3 hours          0.0.0.0:3306->3306/tcp                                                   mysql
8023332452db        debezium/kafka:0.3                      "/docker-entrypoint.s"   3 hours ago         Up 3 hours          0.0.0.0:9092->9092/tcp                                                   kafka
d9e4ccd6e3d8        debezium/zookeeper:0.3                  "/docker-entrypoint.s"   3 hours ago         Up 3 hours          0.0.0.0:2181->2181/tcp, 0.0.0.0:2888->2888/tcp, 0.0.0.0:3888->3888/tcp   zookeeper

I wanted to be able to bolt on the 'kafka-topics-ui', so that I could get a better visual inspection of what was going on. For that, I know I needed to add kafka-rest and schema-registry into the mix, so I followed the approach documented here.

Unlike in that quickstart, I tried adding --net=host and exposing the ports, as per the following commands.

docker run -d --net=host -p 8082:8082 --name=kafka-rest -e KAFKA_REST_ZOOKEEPER_CONNECT=localhost:2181 -e KAFKA_REST_LISTENERS=http://localhost:8082 -e KAFKA_REST_SCHEMA_REGISTRY_URL=http://localhost:8081 confluentinc/cp-kafka-rest:3.0.1

docker run -d --net=host -p 8081:8081 --name=schema-registry -e SCHEMA_REGISTRY_KAFKASTORE_CONNECTION_URL=localhost:2181 -e SCHEMA_REGISTRY_HOST_NAME=localhost -e SCHEMA_REGISTRY_LISTENERS=http://localhost:8081 confluentinc/cp-schema-registry:3.0.1

However, for reasons I'm not fully clear about, these ports don't show up as exposed, which is possibly one of the reasons why kafka-topics-ui is failing.

CONTAINER ID        IMAGE                                   COMMAND                  CREATED             STATUS              PORTS                                                                    NAMES
d8a0b1dbbb26        confluentinc/cp-kafka-rest:3.0.1        "/etc/confluent/docke"   16 minutes ago      Up 16 minutes                                                                                kafka-rest
3869e740d5d3        confluentinc/cp-schema-registry:3.0.1   "/etc/confluent/docke"   17 minutes ago      Up 17 minutes                                                                                schema-registry

Here's the screenshot of the kafka-topics-ui ... where it obviously isn't able to connect properly to the kafka-rest. Is there anything obvious to you that I might be missing here. Is it even possible to mix the debezium containers with the confluent ones ... I was under the impression that the debezium ones are ultimately derived from the confluent ones too.

Thanks for any advice you might have.
Colum

Docker Hub tags

It would be helpful to have versioned Docker Hub tags in addition to the latest tag. This would help guard against unexpected change.

Thanks!

Unable to deserialize avro?

Hi.

I have a topic with some sample data, genereated by the confluent producer with an avro schema.

But when accessing the topic data from landoop-topics ui i get the "binary" data view.

I should add, that we have a working Kafka setup with producers and consumers happily serializing and deserializing Confluent Avro messages. But for some reason topics-ui is not able to see these messages as Avro. I am at a loss at where to look. My google-fu is not strong enough.

Filter messages by text when content is XML?

I have tested on your demo that messages can be filtered by text on Value field but if messages content is in XML format (just XML, not JSON), text can be filtered also?
Also, Table view split XML content in columns?
Is there any example I can see online?

I can't try it as I'm still trying to make topics-ui work with rest-api.

Thanks

lensesio / kafka-topics-ui Goto Github PK

kafka-topics-ui's People

Contributors

Stargazers

Watchers

Forkers

kafka-topics-ui's Issues

Recommend Projects

Recommend Topics

Recommend Org