Skip to content

Python agent namespace support #10317

Description

@Superskyyy

As discussed, there are two available namespace settings that needs to be enhanced.

These are minor changes.

  • Add namespace to service name suffix

  • Add a new kakfa reporter namespace to prefix kafka-topic

Discussed in #10315

Originally posted by xiaozaiyuji January 29, 2023
What happened
I do a test by skywalking python kafka 0.8.0,but it can not find the service in skywalking ui and elasticsearch.I use the oap server with version 9.2.0,and many java agent use kafka reporter had already manage trace by it.But the python application can not find, I check the config many times,and I did many test.I had to get help by the officical ,maybe this is a config error by me,but ,I think it is a rarely mistake by me.

What you expected to happen
I want to see the python application in the skywalking ui,

How to reproduce
Dockerfile is this.

FROM python:3.9

#setting the environment
ENV SW_AGENT_NAMESPACE v92
ENV SW_AGENT_COLLECTOR_BACKEND_SERVICES http://oap-server.address/
ENV SW_AGENT_PROTOCOL kafka
ENV SW_KAFKA_REPORTER_BOOTSTRAP_SERVERS "kafka1:port"
ENV SW_AGENT_INSTANCE skywalking-python-test
ENV SW_AGENT_NAME skywalking-python-test

install telnet
RUN apt-get update &&
apt-get install -y --no-install-recommends telnet &&
apt-get clean &&
rm -rf /var/lib/apt/lists/*;

install dependency
COPY requirements.txt requirements.txt
RUN pip install -r /requirements.txt

print the infomation
RUN pip --version
RUN pip list

RUN mkdir /release
COPY / /release/
WORKDIR /release
EXPOSE 8080
CMD ["sw-python","run","python3","app.py"]`'''

app.py

from aiohttp import web

routes = web.RouteTableDef()

@routes.get('/healthCheck')
async def health_check(request):
return web.Response(text="OK")

if name == "main":
app = web.Application()
app.add_routes(routes)
web.run_app(app, host="0.0.0.0", port=8080)

requirements.txt

apache-skywalking[kafka]
aiohttp==3.7.4

Anything else
the log is as follows

skywalking [MainThread] [WARNING] plugin sw_bottle failed to install, please disregard this warning if the corresponding package was not used in your project
2023-01-29T08:57:38.080541949Z skywalking [MainThread] [WARNING] plugin sw_celery failed to install, please disregard this warning if the corresponding package was not used in your project
2023-01-29T08:57:38.081060151Z skywalking [MainThread] [WARNING] plugin sw_django failed to install, please disregard this warning if the corresponding package was not used in your project
2023-01-29T08:57:38.081177214Z skywalking [MainThread] [WARNING] plugin sw_elasticsearch failed to install, please disregard this warning if the corresponding package was not used in your project
2023-01-29T08:57:38.081522769Z skywalking [MainThread] [WARNING] plugin sw_falcon failed to install, please disregard this warning if the corresponding package was not used in your project
2023-01-29T08:57:38.081794040Z skywalking [MainThread] [WARNING] plugin sw_fastapi failed to install, please disregard this warning if the corresponding package was not used in your project
2023-01-29T08:57:38.081898196Z skywalking [MainThread] [WARNING] plugin sw_flask failed to install, please disregard this warning if the corresponding package was not used in your project
2023-01-29T08:57:38.084788975Z skywalking [MainThread] [WARNING] plugin sw_mysqlclient failed to install, please disregard this warning if the corresponding package was not used in your project
2023-01-29T08:57:38.085171451Z skywalking [MainThread] [WARNING] plugin sw_psycopg failed to install, please disregard this warning if the corresponding package was not used in your project
2023-01-29T08:57:38.085723379Z skywalking [MainThread] [WARNING] plugin sw_psycopg2 failed to install, please disregard this warning if the corresponding package was not used in your project
2023-01-29T08:57:38.085757244Z skywalking [MainThread] [WARNING] plugin sw_pymongo failed to install, please disregard this warning if the corresponding package was not used in your project
2023-01-29T08:57:38.086524734Z skywalking [MainThread] [WARNING] plugin sw_pymysql failed to install, please disregard this warning if the corresponding package was not used in your project
2023-01-29T08:57:38.086535096Z skywalking [MainThread] [WARNING] plugin sw_pyramid failed to install, please disregard this warning if the corresponding package was not used in your project
2023-01-29T08:57:38.086554099Z skywalking [MainThread] [WARNING] plugin sw_rabbitmq failed to install, please disregard this warning if the corresponding package was not used in your project
2023-01-29T08:57:38.086694331Z skywalking [MainThread] [WARNING] plugin sw_redis failed to install, please disregard this warning if the corresponding package was not used in your project
2023-01-29T08:57:38.087051310Z skywalking [MainThread] [WARNING] plugin sw_requests failed to install, please disregard this warning if the corresponding package was not used in your project
2023-01-29T08:57:38.087367258Z skywalking [MainThread] [WARNING] plugin sw_sanic failed to install, please disregard this warning if the corresponding package was not used in your project
2023-01-29T08:57:38.088014390Z skywalking [MainThread] [WARNING] plugin sw_tornado failed to install, please disregard this warning if the corresponding package was not used in your project
2023-01-29T08:57:38.088024525Z skywalking [MainThread] [WARNING] plugin sw_urllib3 failed to install, please disregard this warning if the corresponding package was not used in your project

As a result,the skywalking ui and es can not find the application, I had already confirm that the network about oap server and the kafka server is right.So ,can any body help me to find what's wront

Metadata

Metadata

Assignees

No one assigned

    Labels

    agentLanguage agent related.bugSomething isn't working and you are sure it's a bug!pythonPython agent related

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions